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FOREWORD 


This  paper  is  an  attempt  to  identify  and  structure  a  list 
of  cost  elements  that  captures  all  costs  needed  to  conduct 
life-cycle  cost-effectiveness  analyses  of  alternative  military 
training  programs,  courses,  and  devices  for  the  institutional 
training  of  U.S.  personnel,  regardless  of  the  conditions  or 
assumptions  imposed  by  the  particular  application  or  problem 
of  interest.  A  cost  element  structure  (CES)  designed  for  this 
objective  may  not  apply  (without  some  modification)  to:  (a)  the 
training  of  foreign  military  students;  (b)  field  training  detach¬ 
ments  and  on-the-job  training  in  operational  commands;  (c)  train¬ 
ing  exercises  in  and/or  by  operational  commands;  (d)  residencies, 
fellowship  programs,  and  non-resident  and  correspondence  courses; 
and  (e)  the  determination  of  total  budget  requirements  for  the 
training  systems,  courses,  or  devices  of  interest. 

The  main  need  for  such  a  definitive  CES  relevant  to  mili¬ 
tary  training  is  to  enable  consistent  and  credible  evaluations 
of  the  cost-effectiveness  of  alternative  training  programs. 

An  earlier  draft  of  this  paper  was  distributed  widely 
throughout  the  defense  training  community  and  headquarters  of 
the  military  departments  to  solicit  suggestions  for  making  the 
proposed  CES  more  comprehensible  and  suitable  for  use  by  indi¬ 
viduals  concerned  with  military  training  throughout  the  Depart¬ 
ment  of  Defense. 

Thoughtful  and  constructive  critiques  were  received  from 
over  30  individuals  in  the  three  military  departments  and 
several  companies.  Many  of  their  recommendations  are  reflected 
in  this  paper. 
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The  most  significant  comments  can  be  grouped  in  seven 
categories  regarding  the  development  of  a  common  CES  for  use 
in  cost-effectiveness  (C-E)  analyses.  These  categories  are 
identified  and  discussed  briefly'  in  the  following  paragraphs. 

1 .  The  need  for  a  standardized,  comprehensive  CES  appli¬ 
cable  to  training  programs,  courses,  and  devices. 

Well  over  half  of  the  reviewers  acknowledged  a  long-standing 
need  for  a  standardized  CES  for  use  by  the  military  training  com¬ 
munity  to  improve  relevance,  completeness,  and  comparability  of 
costs  among  alternatives;  to  provide  a  common  basis  for  cost  data 
generation  and  collection;  and  to  improve  communication  among  the 
various  organizations  concerned  with  training. 

2 .  Adaptability  of  a  weapon-system-based  CES  to  training 
programs,  courses,  and  devices. 

The  CES  proposed  in  the  draft  version  of  this  paper  was 
based  on  the  time-honored  weapon  system  CES.  About  one-third 
of  the  respondents  questioned  the  practicality  of  basing  a 
training  CES  upon  the  generally  acceded  weapon  system  CES. 

Aided  by  comments  and  documents  f J  f:\ed  by  the  respondents, 
the  CES  in  this  paper  incorporates  substantial  modifications 
to  accommodate  functions,  activities,  and  resources  that  are 
typical  of  military  training. 

3.  The  (a)  availability  of  relevant  cost  data,  and 
(b)  Impact  of  a  new  CES  on  existing  accounting  systems. 
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About  one-third  of  those  who  reviewed  the  draft  paper 
expressed  concern  about  one  or  both  of  these  subjects.  Obvi¬ 
ously,  the  two  are  interrelated. 

The  requirement  for  a  general  method  for  estimating 
the  cost-effectiveness  of  alternative  training  modes  led 
to  the  formulation  of  a  comprehensive  cost  element  struc¬ 
ture  that,  when  refined,  should  be  usable  throughout  the 
training  community.  The  use  of  a  common  CES  need  not 
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require  changes  in  existing  accounting  systems.  It  is  recog¬ 
nized  that  differences  in  accounting  systems,  nomenclature  of 
cost  elements,  and  data  requirements  and  data  collection  pro¬ 
cedures  among  (and  within)  the  Services  preclude  precise  and 
complete  correspondence  between  financial  data  and  cost  elements 
for  all  C-E  analyses  among  all  Services.  If,  however,  there 
is  to  be  comparability  among  C-E  analyses  of  alternative  courses 
of  action  and,  if  credibility  in  the  analyses  that  support 
requests  for  implementation  is  to  be  reasonably  assured,  refer¬ 
ence  to  a  standard  CES  is  advantageous.  A  standard  CES,  how¬ 
ever,  no  matter  how  comprehensive,  is  not  a  surrogate  for  good 
judgment  in  C-E  analyses.  To  make  certain  that  all  pertinent 
costs  are  included  in  C-E  analyses,  it  would  be  appropriate  for 
C-E  analysts  to  specify  those  elements  of  the  standard  CES  that 
may  be  omitted  as  irrelevant,  and  pertinent  elements  that  are 
implicit  in  elements  that  may  be  titled  differently  to  maintain 
consistency  with  Service-peculiar  cost  accounting  systems. 

4.  The  degree  of  emphasis  by  upper  management. 

A  number  of  reviewers  attributed  shortcomings  in  C-E 
analyses  of  training  more  to  insufficient  top-management 
emphasis  than  to  a  lack  of  appropriate  C-E  methodology.  It 
may  be  expected  that  implementation  of  the  recommendations  made 
by  the  Defense  Science  Board  in  their  recent  Summer  Study, 
Training  and  Training  Technology  (November  1982),  will  provide 
added  impetus  to  the  development  of  more  rigorous  C-E  analyses 
of  alternative  training  methods  and  a  repository  for  data  on 
the  costs  and  effectiveness  of  various  types  of  military  train¬ 
ing. 

5 .  References  to  Interservice  Training  Review  Organiza¬ 
tion  (ITRO)  cost  analysis  procedures  and  model. 

A  number  of  reviewers  referred  to  existing  and  proposed 
ITRO  documents  as  guidance  for  the  development  of  a  standard¬ 
ized  CES.  At  the  same  time,  they  acknowledged  that  since  ITRO’s 

v 


•  .v 

I  a  I  At  M  kV  *t  V 


principal  goal  is  the  realization  of  cost  savings  that  may 
result  from  collocation  or  consolidation  of  training  courses 
among  the  Services,  ITRO's  cost  analysis  methodology  is  not 
adequate  for  cost-effectiveness  analyses  based  upon  life-cycle 
costs.  ITRO’s  approach  omits  the  R&D  and  many  of  the  Initial 
Investment  costs  that  are  contained  in  the  comprehensive  life- 
cycle  cost  structure  that  is  the  subject  of  this  paper.  The 
Operating  and  Support  cost  category  of  this  CES,  however,  is 
based,  in  large  part,  on  ITRO's  proposed  "Services  Standard 
Course  Cost  Procedures  Handbook." 

6 .  The  relationship  between  cost  elements  and  the  appro¬ 
priations  by  which  the  elements  would  be  funded. 

A  few  reviewers  felt  that  information  relating  the  cost 
elements  to  budget  appropriations  would  enhance  communication 
among  cost  analysts,  budgeteers,  training  managers,  and  other 
decision  makers.  An  attempt  to  develop  cost  element-to- 
appropriation  relationships  (often  called  a  "cross-walk")  is 
the  subject  of  Appendix  B. 

7 .  The  need  for  other  cost  elements,  definitions,  and 
clarification  of  terms  used. 

Many  recommendations  of  this  nature  were  adopted  for  this 
paper.  "Depreciation,"  although  considered  In  some  Service 
procedures  for  cost  analysis  of  military  training,  is  not 
included  in  this  proposed  CES.  Depreciation  may  be  appropriate 
as  an  element  of  economic  analysis,  but  it  serves  no  purpose 
in  a  C-E  analysis  that  compares  the  annual,  future  expenditures 
which  would  be  incurred  for  alternative  methods  of  achieving 
a  training  objective. 
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SUMMARY 


A.  PURPOSE 

This  paper  identifies,  structures,  and  defines  a  list  of 
cost  elements  that  is  intended  to  describe  fully  the  life-cycle 
cost  of  any  formal  program,  course,  or  device  for  individual 
training  of  DoD  personnel,  regardless  of  the  conditions  or 
assumptions  imposed  by  the  particular  application  or  problem 
of  interest .  1 

The  principal  need  for  such  a  definitive  cost  element 
structure  (CES)  relevant  to  military  training  is  to  enable  con¬ 
sistent  and  credible  evaluations  of  the  cost-effectiveness  of 
alternative  methods  of  training. 

B.  BACKGROUND 

Training  is  a  necessary  and  expensive  activity  needed  to 
maintain  military  readiness.  In  fiscal  year  1984,  for  example, 
individual  training  at  Service  schools  was  estimated  to  cost 
$13.4  billion  and  to  account  for  about  20  percent  of  all  man¬ 
power  allocated  to  the  Services. 

The  Defense  Science  Board,  in  1976  and  again  in  1982, 
recommended  that  cost-effectiveness  evaluations  of  military 
training  be  performed  to  optimize  the  use  of  available  training 

lrThls  study  was  performed  for  the  Office  of  the  Deputy  .Under  Secretary  of 
Defense  for  Research  and  Engineering  (Research  and  Advanced  Technology) 
under  the  technical  cognizance  of  the  Military  Assistant  for  Training  and 
Personnel  Technology,  and  for  the  Office  of  the  Assistant  Secretary  of 
Defense  (Manpower,  Reserve  Affairs  and  Logistics)  under  the  technical  cog¬ 
nizance  of  the  Director,  Training  and  Education.  The  technical  officers 
were  Captain  Paul  R.  Chatelier  (USN)  and  Michael  Kendall,  respectively. 
Gary  Boycan  is  the  current  technical  officer  at  MRA&L. 


resources  and  to  defend  investments  in  new  training  equipment 
and  technologies.  The  Board  found  that  data  needed  to  develop 
and  evaluate  training  programs  are  inadequate;  this  perpetuates 
the  weak  position  of  training  in  competing  for  funds,  and  in 
demonstrating  its  value. 

Our  review  of  the  cost  analyses  in  well  over  100  studies 
of  defense  training  was  consistent  with  the  Board’s  finding. 

We  observed  that  cost  data  are  often  fragmentary,  are  too 
highly  aggregated,  and  are  not  always  comparable.  Furthermore, 
we  found  that  the  use  of  formal  cost  models  is  not  documented 
in  most  studies  on  the  cost-effectiveness  of  defense  training; 
yet,  a  formal  cost  model  is  essential  to  credible  cost- 
effectiveness  analysis. 

In  general,  it  appears  that  no  standardized  methodology 
for  analysis  of  training  costs  has  been  developed,  nor  have 
cost  data  been  acquired  in  accordance  with  a  common  set  of 
definitions. 

C.  THE  COST  ELEMENT  STRUCTURE 

A  necessary  early  step  in  the  formulation  of  any  cost- 
effectiveness  model  is  the  identification  and  logical  organiza¬ 
tion  of  the  functional  elements  of  cost  that  constitute  life- 
cycle  cost  so  that  alternatives  can  be  compared  equitably. 

This  paper  is  intended  to  provide  such  a  structured  list  of 
cost  elements. 

This  CES,  and  the  cost-effectiveness  model(s)  of  which  it 
would  become  a  part,  would  be  used  by  acquisition  and  manpower 
planners,  and  developers  of  weapon  and  support  systems  to  esti¬ 
mate  the  cost-effectiveness  of  alternative  ways  to  train  opera¬ 
tional  and  maintenance  personnel.  With  its  intended  use  i.  mind 

1.  This  CES,  and  the  associated  definitions,  were  devel¬ 
oped  with  reference  to  a  number  of  authoritative  and  widely-used 
cost  guides  issued  by  and  for  the  training  and  weapon  system 


communities  of  the  Services  and  offices  of  the  Secretary  of 
Defense.  Its  use  as  a  guide  in  the  conduct  of  cost  analyses 
should  have  minimum  impact  on  existing  financial  structures 
and  cost-accounting  procedures. 

2.  It  should  be  sufficiently  comprehensive  and  detailed 

to: 

a.  Capture  all  elements  of  the  life-cycle  cost  of 
any  training  program,  course,  or  device,  regardless  of  its 
size,  complexity,  or  cost. 

b.  Permit  identification  of  cost  elements  that  are 
the  major  contributors  to  total  cost. 

c.  Enable  Individuals  with  singular  interests  (e.g., 
manpower  planners,  training  and  procurement  specialists)  to 
identify  resources  of  particular  interest  to  them,  and  to 
evaluate  the  implications  of  those  resources  in  a  total-program 
context . 

3.  The  cost  elements  are  function-,  activity-,  and 
resource-oriented  to  permit  their  integration  with  work-breakdown 
structures  (WB3)  that  are  unique  to  various  training  programs, 
courses,  and  devices. 

An  earlier  draft  of  this  paper  was  distributed  widely 
throughout  the  defense  training  community  and  headquarters  of 
the  military  departments  to  solicit  suggestions  for  improving 
its  comprehensibility  and  suitability.  Many  of  their  recom¬ 
mendations  are  reflected  in  this  paper. 

D.  ADVANTAGES  OF  THE  COST  ELEMENT  STRUCTURE 

The  general  use  of  a  comprehensive  cost  element  structure 
for  military  training,  such  as  the  one  proposed  in  this  paper, 
would  offer  several  advantages  for  evaluating  the  costs  of 
training  programs,  courses,  and  devices. 


#> 


1.  Used  as  a  guide  to  estimate  costs,  it  would  ensure 
that  all  costs  incurred  during  the  life  cycle  (or  period  of 
interest)  of  a  training  program,  course,  or  device  would  be 
accounted  for.  Gaps  in  essential  data  may  be  identified  in 
this  way. 

2.  It  would  permit  making  comparisons  among  training 
options  that  are  reliable  and  that  can  be  used  with  confidence. 

3-  The  level  of  detail  should  be  adequate  to  identify 
the  cost  element (s)  that  account  for  the  major  costs  of  a  train¬ 
ing  program,  course,  or  device.  Identification  of  major  costs, 
i.e.,  ’’cost  drivers,”  would  permit  one  to  focus  attention  on 
areas  for  significant  cost  reduction  or  for  trade-off  analyses 
between  high-cost  items  and  effectiveness.  It  should  also 
assist  in  identifying  significant  variables  for  use  in  the 
development  of  cost-estimating  relationships. 

4.  This  CES  is  a  synthesis  of  cost  analysis  guidance  of 
the  weapon-system  and  training  communities  of  the  Services  and 
offices  of  the  Secretary  of  Defense.  As  such,  its  general  use 
should  enhance  communication  and  understanding  among  people 
concerned  with  various  aspects  of  training  (e.g.,  procurement, 
manpower,  providing  the  training)  and  those  involved  with  other 
aspects  of  weapon  system  programs  on  subjects  of  mutual  con¬ 
cern  (e.g.,  cost  estimates,  trade-offs  between  cost  and  effec¬ 
tiveness  of  alternative  training  programs,  and  the  allocation 
of  resources  among  mission  areas,  systems,  and  programs). 
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I.  INTRODUCTION 


A.  PURPOSE 

The  purpose  of  this  paper  is  to  identify  and  structure  a 
list  of  cost  elements  that  will  describe  fully  the  life-cycle 
cost  of  any  formal  program  or  course,  or  device  for  individual 
training  of  U.S.  personnel,  regardless  of  the  conditions  or 
assumptions  imposed  by  the  particular  application  or  problem 
of  interest.  The  focus  on  formal,  individual  training  (also 
referred  to  as  institutional  training)  omits  consideration  of 
training  in  operational  mission  units,  field  training  detach¬ 
ments,  on-the-job  training,  residencies  (including  the  Service 
academies),  fellowship  programs,  and  non-resident  and  corre¬ 
spondence  programs. 

The  main  need  for  such  a  definitive  cost  element  structure 
(CES)  is  to  enable  consistent  and  credible  evaluations  of  the 
costs  of  alternative  means  to  satisfy  a  specific  training 
requirement . 

This  paper  is  part  of  an  effort  to  satisfy  a  recognized 
need  for  a  general  method  that  can  be  used  by  acquisition  and 
manpower  planners,  and  developers  of  weapon  and  support  sys¬ 
tems  in  and  for  the  military  Services,  to  estimate  the  cost- 
effectiveness  of  alternative  ways  to  train  operational  and 
maintenance  personnel.  The  general  use  of  such  a  method  should 
assist  policymakers  and  decisionmakers  at  various  levels  in 
the  Services  and  the  Office  of  the  Secretary  of  Defense  (OSD) 
to  make  more  credible  judgments  concerning  the  efficient  allo¬ 
cation  of  resources  available  for  military  training. 


Since  this  is  an  early  effort,  it  is  anticipated  that  this 
cost  element  structure  will  be  modified  and  improved  on  the 
basis  of  experience  with  its  use. 

B.  BACKGROUND 

Training  is  a  necessary  and  expensive  activity  needed  to 
maintain  military  readiness.  In  fiscal  year  1984,  for  example, 
individual  training  at  Service  schools  was  estimated  to  cost 
$13.4  billion  and  to  account  for  about  20  percent  of  all  man- 
years  allocated  to  the  Services  [Office  of  the  Assistant  Secre¬ 
tary  of  Defense  (Manpower,  Reserve  Affairs  and  Logistics,  1983)]. 
Both  the  cost  and  effectiveness  of  formal,  individual  military 
training  are  examined  by  the  Congress,  the  OSD,  and  the  individ¬ 
ual  Services  (e.g.,  Defense  Science  Board  1982,  Orlansky  and 
String  1979  and  1981,  String  and  Orlansky  1977).  Attention  has 
been  directed  towards  the  cost  and  effectiveness  of  flight 
simulators,  computer-based  instruction,  unit  training,  and  field 
exercises . 

Our  review  of  the  cost  analyses  in  well  over  100  studies 
of  training  in  the  last  six  years  reveals  some  fundamental 
deficiencies  that  limit  meaningful  cost-effectiveness  compari¬ 
sons  among  alternatives: 

1.  The  use  of  formal  cost  models  is  not  documented  in 
most  studies  on  the  cost-effectiveness  of  military 
training  systems;  yet  a  formal  cost  model  is  essen¬ 
tial  to  credible  cost-effectiveness  analysis.  With¬ 
out  explicit  ident if ication  of  all  relevant  costs 
and  assumptions,  one  cannot  be  certain  that  alterna¬ 
tives  are  compared  in  a  consistent  manner. 

1See  complete  references  at  the  end  of  this  paper. 


2.  Available  cost  data  are  fragmentary,  are  too  highly 
aggregated,  and  are  not  always  comparable.  Reasons 
for  these  shortcomings  include  the  following: 

a.  The  apparent  lack  of  reliance  on  formal  cost  models 
that  include  standardized  definitions  of  cost 
elements. 1 

b.  The  acquisition  costs  of  many  training  programs 
(e.g.,  computer-based  instruction)  fall  below 
the  threshold  of  "major"  programs  for  which  con¬ 
tractors  are  required  to  use  prescribed  formats 
in  periodic  cost  reports. 

c.  Training  equipment  is  often  procured  via  firm 
fixed-price  (FPP)  and  fixed-price  incentive-fee 
(FPIF)  contracts.  Such  contracts  provide  the 
Services  little  leverage  in  the  specification  of 
cost  detail.  Even  when  cost-plus-fixed-fee  (CPFF) 
contracts  have  been  employed,  the  Services'  project 
offices  have  not  always  required  contractors  to 
furnish  cost  data  in  standardized  formats. 

In  general,  it  appears  that  no  standardized  methodology 
for  analysis  of  training  costs  has  been  developed,  nor  have 
cost  data  been  acquired  in  accordance  with  a  common  set  of 
definitions . 


1 Definitions  of  cost  elements  are  not  given  in  the  majority  of  studies  of 
military  training  costs  reviewed  to  date. 


II.  COST  ELEMENT  STRUCTURE 


A.  APPROACH 

A  necessary  early  step  in  the  formulation  of  any  cost- 
effectiveness  model  is  the  delineation  and  logical  organiza¬ 
tion  of  the  functional  elements  of  cost  that  constitute  life¬ 
cycle  cost  so  that  alternatives  can  be  compared  equitably. 

This  paper  is  intended  to  provide  such  a  structured  list  of 
cost  elements. 

Several  criteria  and  ground  rules  were  adopted  to  guide 
development  of  the  cost  element  structure  ( CES )  in  this  paper. 


This  CES  should  be  sufficiently  comprehensive  to  capture 
all  elements  of  the  life-cycle  cost  of  any  institutional  train 
ing  program,  course,  or  device  (p/c/d),  regardless  of  its  size 
complexity,  or  cost.  The  level  of  detail  should  be  adequate 
to  identify  the  cost  elements  that  are  the  major  contributors 
(i.e.,  the  "cost  drivers")  to  the  total  cost  of  a  p/c/d. 


P  r  i  n  c  i 


This  CES,  and  the  cost-effectiveness  model(s)  of  which 
it  would  become  a  part,  would  be  used  principally  in  planning 
for  alternative,  new  training  p/c/d's,  and  in  evaluations  of 
substantial  modifications  to  existing  p/c/d's. 


3. 


Definition  of  11  Cost 


In  choosing  among  alternative  programs,  courses,  or  devices 
designed  to  satisfy  a  particular  training  requirement,  decision¬ 
makers  will  be  concerned  with  the  future  expenditures  of  DoD 
resources  to  acquire  and/or  operate  each  alternative.  In  this 
context,  "cost"  is  defined  as  future  expenditures  of  DoD 
resources  occasioned  by  the  design,  development,  implementation, 
and/or  operation  of  a  training  p/c/d. 

4 .  Consideration  of  Service  Financial /Cost  Accounting  Procedures 

The  Services  use  various  procedures  to  estimate  training 
costs.  A  priori,  the  methods  in  use  are  compatible  with  their 
financial  and  cost  accounting  procedures.  While  those  methods 
may  be  adequate  for  the  Services’  internal  use,  they  comprise 
cost  elements  that  are  not  always  understood  or  accepted  through¬ 
out  the  defense  training  community,  and  at  the  DoD  level  where 
final  decisions  are  made  on  allocations  of  limited  resources, 
among  the  Services,  mission  areas,  systems,  and  activities.  One 
criterion  observed  in  the  development  of  this  CES  was  that  its 
adoption  should  not  necessitate  changes  in  existing  financial 
and  accounting  systems.  Accordingly,  it  was  formulated  with 
reference  to  a  number  of  DoD  and  Service  cost/economic  analysis 
guides  and  procedures. 

5 .  Consideration  of  Work  Breakdown  Structures 

A  defense  system  or  item  of  major  equipment  is  described 
by  its  discrete  segments  (i.e.,  components  or  subsystems)  to 
facilitate  management  planning  and  control  of  the  R&D  and  pro¬ 
duction  phases  of  its  life  cycle.  The  procedure  is  formalized 
as  a  work  breakdown  structure  (WBS)  that  is  tailored  to  the 
particular  system  or  equipment  of  interest  (Department  of 
Defense,  MIL-STD-881,  1968).  This  practice  usually  is  applied 
to  training  p/c/d’s  of  substantial  size  and  complexity  (e.g.,  a 
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trainer  aircraft,  a  weapon  system  simulator).  The  CES  developed 
in  this  paper  is  intended  to  apply  to  any  institutional  train¬ 
ing  p/c/d,  regardless  of  its  type,  size,  complexity,  or  materiel 
content.  It  is  impractical,  therefore,  to  anticipate  WBSs  suit¬ 
able  to  all  p/c/d's;  hence,  the  cost  elements  in  this  CES  are 
function-,  activity-,  and  resource-oriented.  It  is  left  to 
those  concerned  with  analysis  of  individual  p/c/d's  to  select 
pertinent  cost  elements  from  this  structure  and  to  integrate 
them  into  the  p/c/d  WBSs. 

B.  A  PROPOSED  COST  ELEMENT  STRUCTURE  APPLICABLE  TO  TRAINING 

The  comprehensive  cost  element  structure  presented  in 
Table  1  was  constructed  so  that  relevant  elements  can  be  selected 
to  describe  fully  the  life-cycle  cost  (or  portion  thereof)  of 
any  training  program,  course,  or  device,  regardless  of  the  con¬ 
straints,  assumptions,  or  other  conditions  imposed  by  the  partic¬ 
ular  application  or  problem  presented.  It  is  expected  that 
suggestions  for  improvement  would  result  from  experience  with 
its  use . 1 

The  cost  elements  are  grouped  by  cost  category.  Cost 
elements  in  the  Research  and  Development  and  Initial  Investment 
categories  are  based  on  those  that  have  been  used  throughout 
the  Department  of  Defense  for  many  years  to  detail  the  acquisi¬ 
tion  costs  of  weapon  systems.  They  have  been  modified,  however, 
to  accommodate  functions,  activities,  and  resources  that  are 
typical  of  military  training.  Training  course  cost  guidance 
developed  by  the  Interservice  Training  Review  Organization 
(ITRO)  was  instrumental  in  the  generation  of  the  Operating 
and  Support  category.  Some  training  p/c/d's  are  unique  to 
specific  weapon  systems.  Other  training  course  materials  and 
equipment  are  developed  for  general  types  of  training  at  schools. 

*An  earlier  draft  of  this  paper  was  reviewed  by  about  30  members  of  the 
defense  training  conmunity  and  headquarters  of  the  military  departments. 

Many  of  their  comnents  and  reconnendations  are  reflected  in  this  paper. 
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Table  1.  A  COMPREHENSIVE  COST  ELEMENT  STRUCTURE  FOR  MILITARY 
TRAINING  PROGRAMS,  COURSES,  AND  DEVICES 

A.  RESEARCH  AND  DEVELOPMENT 

1.  Design 

a.  Pay  and  Allowances 

(1)  Military 

(2)  Civilian 

b.  Other  Government  Personnel  Costs 

(1)  Military 

(2)  Civilian 

c.  Other 

2.  Component  Development 

a.  Pay  and  Allowances 

(1)  Military 

(2)  Civilian 

b.  Other  Government  Personnel  Costs 

(1)  Military 

(2)  Civilian 

c.  Other 

3.  Producibility  Engineering  and  Planning 

a.  Pay  and  Allowances 

(1)  Military 

(2)  Civilian 

b.  Other  Government  Personnel  Costs 

(1)  Military 

(2)  Civilian 

c.  Other 

4.  Too^ng 

a.  Pay  and  Allowances 

(1)  Military 

(2)  Civilian 
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Tabl e  1  ( continued) 

b.  Other  Government  Personnel  Costs 

(1)  Military 

(2)  Civilian 

c.  Other 

5.  Prototype  Manufacturing 

a.  Pay  and  Allowances 

(1)  Military 

(2)  Civilian 

b.  Other  Government  Personnel  Costs 

(1)  Military 

(2)  Civilian 

c.  Other 

6.  Data 

a.  Managerial  Data 

(1)  Pay  and  Allowances 

(a)  Military 

(b)  Civilian 

(2)  Other  Government  Personnel  Costs 

(a)  Military 

(b)  Civilian 

(3)  Other 

b.  Technical  Data 

.  (1)  Pay  and  Allowances 

(a)  Military 

(b)  Civilian 

(2)  Other  Government  Personnel  Costs 

(a)  Military 

(b)  Civilian 

(3)  Other 
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Table  1  (continued) 


P/C/D  Test  and  Evaluation 


a.  Pay  and  Allowances 


(1)  Military 

(2)  Civilian 


b.  Other  Government  Personnel  Costs 


(1)  Military 

(2)  Civilian 


c.  Other 


System/Project  Management 


a.  Pay  and  Allowances 


(1)  Military 

(2)  Civilian 


b.  Other  Government  Personnel  Costs 


(1)  Military 

(2)  Civilian 


Other 


Facilities 


Other 


•  • 
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INITIAL  INVESTMENT 


1.  Production 

a.  Nonrecurring 

(1)  Production  Planning 

(2)  Production  Tooling  and  Equipment 

(3)  Industrial  Facilities 

(4)  Other 

b.  Recurring 

(1)  Manufacturing 

(2)  Sustaining  Engineering 

(3)  Sustaining  Tooling 

(4)  Quality  Assurance 

(5)  Other 

c.  Initial  Spares  and  Repair  Parts 

2.  Engineering  Changes 

3.  Purchased  P/C/D  -  Peculiar  Equipment 

4.  Common  Equipment 
5-  Data 

a.  Managerial  Data 

(1)  Pay  and  Allowances 

(2)  Other  Government  Personnel  Costs 

(3)  Other 

b.  Technical  Data 

(1)  Pay  and  Allowances 

(2)  Other  Government  Personnel  Costs 

(3)  Other  . 

c.  Instructional  Materials 

(1)  Pay  and  Allowances 

(2)  Other  Government  Personnel  Costs 

(3)  Other 


Table  1  (continued) 
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6.  Trairing  P/C/D  Test  and  Evaluation 

a.  Pay  and  Allowances 

b.  Other  Government  Personnel  Costs 

c.  Other 

7.  System/Project  Management 

a.  Pay  and  Allowances 

b.  Other  Government  Personnel  Costs 

c.  Other 

8.  Rents 

9.  Operational/Site  Activation 

10.  Initial  Training 

a.  Instructors 

b.  Maintenance  Personnel 

11.  Transportation 

a.  First-Destination 

b.  Second-Destination 

12.  Other 


Table  1  (continued) 
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C.  OPERATING  AND  SUPPORT 
1.  Direct  Costs 

a.  Instructional  Costs 

(1)  Pay  and  Allowances 

(a)  Instructors 
.1  Military 
2  Civilian 

(b)  Supervisors,  Administrators  and  Support 
Personnel 

1  Military 

2  Civilian 

(c)  Maintenance  Personnel 

1  Military 

2  Civilian 

(2)  Other  Government  Personnel  Costs 

(a)  Military 

(b)  Civilian 

(3)  Consumption 

(a)  POL 

(b)  Training  Munitions 

(c)  Utilities 

1  Electric  Power 

2  Other 

(d)  Instructional  Materials 

(e)  Other 

( 4 )  Replenishment  Spares 

(5)  Modification  Materiel 

(6)  Depot  Maintenance 

(a)  Labor  and  Materials 

(b)  Second  Destination  Transportation 

(c)  Other 

13 


Table  1  (continued) 


(7)  Other  Purchased  Services 

(8)  Other 

b.  Training  Activity  Costs 

(1)  Pay  and  Allowances 

(a)  Military 

(b)  Civilian 

(2)  Other  Government  Personnel  Costs 

(a)  Military 

(b)  Civilian 

(3)  Other 

(a)  Consumables 

(b)  Other 

c.  Airfield  and  Carrier  Operations  Costs 

(1)  Pay  and  Allowances 

(a)  Military 

(b)  Civilian 

(2)  Other  Government  Personnel  Costs 

(a)  Military 

(b)  Civilian 

(3)  Other 

d.  Student  Costs 

(1)  Pay  and  Allowances 

(a)  Military 

(b)  Civilian 

(2)  Other  Student  Costs 
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Ta  bl e  1  ( continued ) 

(a)  Military 

(b)  Civilian 
e.  Other  Direct  Costs 

2.  Indirect  Costs 

a.  Base  Operations 

(1)  Pay  and  Allowances 

(a)  Military 

(b)  Civilian 

(2)  Other  Government  Personnel  Costs 

(a)  Military 

(b)  Civilian 

(3)  Other 

b.  Inventory  and  Supply  Management 

(1)  Pay  and  Allowances 

(a)  Military 

(b)  Civilian 

(2)  Other  Government  Personnel  Costs 

(a)  Military 

(b)  Civilian 

(3)  Other 

c.  Military  Family  Housing  Support 
(1)  Pay  and  Allowances 

(a)  Military 

(b)  Civilian 


(2)  Other  Government  Personnel  Costs 


Table  1  (continued) 


(a)  Military 

(b)  Civilian 
(3)  Other 

d.  Command  Support  Costs 

(1)  Pay  and  Allowances 

(a)  Military 

(b)  Civilian 

(2)  Other  Government  Personnel  Costs 

(a)  Military 

(b)  Civilian 

(3)  Other 

e.  Other  Indirect  Costs 


Nevertheless,  it  is  felt  that  this  CES,  which  reflects  cost¬ 
estimating  procedures  of  the  weapon  system  and  military  train¬ 
ing  communities,  can  be  applied  to  all  types  of  institutional 
training  programs,  courses,  and  devices. 

The  proposed  cost  element  structure,  and  the  associated 
definitions,  are  derived  from  the  following  authoritative  and 
widely  used  cost  guides: 

Department  of  the  Army 

Research  and  Development  Cost  Guide  for  Army  Materiel 
Systems"  Pamphlet  No.  11-2,  May  1976 

Investment  Cost  Guide  for  Army  Materiel  Systems, 

Pamphlet  No.  11-3 ,  April  1976 

Operating  and  Support  Cost  Guide  for  Army  Materiel 
Systems ,  Pamphlet  No .  11-4 ,  April  1976 

Weapon/Support  Systems  Categories  and  Elements, 

AR37-1B,  15  October  1971 

Office  of  the  Assistant  Secretary  of  Defense  (Comptroller) 

Economic  Analysis  and  Program  Evaluation  for  Resource 
Management ,  DoDI  7041.3,  October  1972 

Uniform  Budget/Cost  Terms  and  Definitions,  DoDI  5000.33, 
August  1977 

Accounting  Guidance  Handbook,  7220. 9-H,  October  1981 

Cost  Analysis  Improvement  Group  (OSD) 

Aircraft  Operating  and  Support  Cost  Development  Guide, 
April  1980  2  £~ 

Naval  Training  Equipment  Center  (U.S.  Navy) 

Cost  and  Schedule  Estimating  System  (CES),  January  1983 

Project  Manager  for  Training  Devices  (U.S.  Army) 

Task  Report  for  Development  of  Cost  Estimating  Relation¬ 
ships  (CER)  for  Support  of  the  Enhanced  Cost  Collection 
System,  July  1981 
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Logistics  Management  Institute 

Aircraft  System  Operating  and  Support  Costs: 
lines  for  Analysis,  March  1977 


Guide- 


The  elements  in  the  Operating  and  Support  cost  category 
were  adapted,  in  large  part,  from  the  ITRO's  proposed  Joint- 
Service  regulation,  Services  Standard  Training  Course  Costs, 
and  its  associated  (draft)  Services  Standard  Training  Course 
Cost  Procedures  Handbook. 

The  elements  listed  in  Table  1  and  the  definitions  that 
follow  are  stated  in  general  terms  in  order  to  accommodate 
differences  in  terminology  among  the  Services.  For  the  purpose 
of  cost-effectiveness  (C-E)  analysis,  this  cost  structure  is 
meant  to  capture  all  relevant  costs  to  the  government1  that  may 
be  incurred  throughout  the  life-cycle  of  a  training  p/c/d.  How 
the  costs  would  be  funded  (Budget  Appropriation,  Budget  Code, 
etc.)  is  incidental  to  C-E  analysis.2 

While  the  structure  in  Table  1  is  designed  to  encompass 
the  life-cycle  costs  of  a  training  p/c/d,  the  format  permits 
Individuals  with  narrower  interests  to  focus  on  specific  cost 
elements  or  groups  of  elements.  It  enables  budgeteers,  man¬ 
power  planners,  and  training  and  procurement  specialists,  for 
example,  to  identify  the  resources  of  primary  concern  to  each 
of  them,  and  to  evaluate  the  implications  of  those  resources 
in  a  total-program  context.  Operating  and  Support  (O&S)  costs, 
for  example,  have  been  the  subject  of  cost  containment  in 
recent  years.  In  personnel-intensive  programs  and  courses 
typified  by  many  types  of  training  (e.g.,  computer-assisted 
and  conventional  group  instruction),  O&S  costs  incurred  during 

1"... costs  to  the  government...."  include  both  payments  to  contractors  and 
expenses  for  government  res  rrces  (e.g.,  military  personnel,  civil  servants, 
government  laboratories,  living  quarters).  See  Section  III,  "Definitions 
of  Cost  Elements,"  for  further  discussion. 

2Ihe  relationships  between  these  cost  elements  and  budget  appropriations 
are  the  subject  of  Appendix  B. 
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years  of  ongoing  Instruction  could  exceed  substantially  the 
costs  of  course  design  and  development  (R&D)  and  implementation 
(Initial  Investment).  The  breakdown  of  the  Operations  and 
Support  category  provides  for  the  many  costs  that  are  associated 
with  personnel  who  are  both  directly  and  indirectly  involved 
in  the  operations  phase  of  a  training  p/c/d.  In  addition  to 
the  obvious  costs  of  pay  and  allowances,  the  sub-element  "Other 
Government  Personnel  Costs"  (which  is  correlative  to  "Pay  and 
Allowances")  includes  other  costs  that  are  properly  attributable 
to  the  assignment  of  individuals  to  a  training  p/c/d.1  Among 
these  are  Permanent  Change  of  Station  (PCS)  and  Temporary  Duty 
(TDY)  costs,  which  may  be  estimated  based  upon  program  char¬ 
acteristics  such  as  numbers  of  personnel,  frequencies  of  moves, 
intensity  of  program-related  business  travel,  etc.  On  the  other 
hand,  other  personnel-related  costs  [e.g..  Personnel  Replacement, 
Health  Care,  and  Base  Operations  (element  C.2.a)]  would  be 
allocated,  usually  on  a  per  capita  basis,  by  each  Service. 

Where  equipment  costs  are  dominant  in  the  R&D  and  Initial  Invest¬ 
ment  phases  of  a  training  p/c/d  (e.g.,  an  aircraft  intended 
solely  as  a  trainer),  the  proposed  CES  provides  appropriate  cost 
elements  (e.g.,  elements  A.l,  2,  3,  and  and  B.l.a  and  b)  to 
be  applied  to  each  major  subsystem  in  the  WBS  (e.g.,  airframe, 
engine,  and  avionics).  In  this  way,  high-cost  subsystems  can 
be  identified  for  possible  cost  reduction  or  intra-system 
trade-off  analysis. 

Since  this  CES  was  developed  to  capture  all  elements  of 
the  life-cycle  cost  of  any  training  p/c/d,  regardless  of  its 
size,  complexity,  or  cost,  it  is  necessary  to  include  cost 
elements  typical  of  the  largest,  most  complex,  and  most  costly 
p/c/d's  (e.g.,  Undergraduate  Pilot  Training).  The  result  is  a 
lengthy  list  of  elements,  many  of  which  would  not  be  applicable 
to  cost  analyses  of  less  extensive  training  p/c/d's.  If,  for 

‘For  details,  see  the  beginning  of  Section  III,  "Definitions  of  Cost  Elements." 
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example,  the  subject  of  C-E  analysis  were  computer-based  instruc¬ 
tion  in  a  schoolhouse  environment,  the  costs  of  Airfield  and 
Carrier  Operations  (element  C.2.c)  and  POL  and  Training  Munitions 
[elements  C.l.a.(3)(a)  and  (b)]  would  be  irrelevant.  Obviously, 
the  applicability  of  each  of  the  cost  elements  in  this  CES 
would  be  dependent  upon  the  nature  and  types  of  the  alternative 
p/c/d’s  under  consideration.1 

Differences  in  nomenclature  of  cost  elements,  accounting 
systems,  and  data  collection  procedures  among  (and  within)  the 
Services  preclude  precise  and  complete  correspondence  between 
financial  data  and  cost  elements  for  all  C-E  analyses  among  all 
Services.  Furthermore,  data  at  the  level  of  detail  shown  in 
this  CES  may  not  be  readily  available  in  the  planning  stage  of 
a  training  p/c/d,  when  C-E  analysis  should  be  done.  When  system- 
specific  data  is  lacking,  generalized  factors  that  may  represent 
aggregations  of  cost  elements  are  often  used.  These  anomolies 
in  Service  practices  and  data  availability  suggest  the  use  of  • 
this  CES  as  a  check  list  to  identify  gaps  in  essential  data  and 
the  need  for  clearer  definitions  of  existing  data. 

Advantages  of  a  Comprehensive  Cost  Element  Structure 

The  general  use  of  a  comprehensive  cost  element  structure 
for  military  training,  such  as  the  one  proposed  in  this  paper, 
would  offer  several  advantages  for  evaluating  the  costs  of 
training  programs,  courses,  and  devices. 

1.  Used  as  a  guide  to  estimate  costs,  it  would  ensure 
that  all  costs  incurred  during  the  life-cycle  (or 
period  of  interest)  of  a  training  p/c/d  would  he 
accounted  for.  Gaps  in  essential  data  may  be 


Action  IV  of  this  paper  illustrates  the  applicability  of  this  proposed 
cost  element  structure  to  a  variety  of  training  programs,  courses,  and 
devices. 
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identified  in  this  way.  Should  the  level  of  aggre¬ 
gation  of  available  cost  data  not  provide  explicit 
information  on  every  pertinent  cost  element,  the 
source(s)  of  the  data  could,  at  least,  be  queried 
to  determine  whether  those  elements  were  included 
in  the  data  that  are  available.  Clearer  defini¬ 
tions  of  such  data  would  make  it  more  useful. 

This  CES  is  a  synthesis  of  cost  analysis  guidance 
issued  for  and  by  the  weapon  system  and  training 
communities  of  the  Services  and  offices  of  the 
Secretary  of  Defense.  As  such,  its  general  use 
should  enhance  communication  and  understanding 
among  people  concerned  with  training  and  those 
involved  with  other  aspects  of  weapon  system  pro¬ 
grams  on  subjects  of  mutual  concern  (e.g.,  cost 
estimates,  trade-offs  between  cost  and  effective¬ 
ness,  and  the  allocation  of  resources  among  mission 
areas,  systems,  and  programs). 

The  level  of  detail  should  be  adequate  to  identify 
the  cost  element(s)  that  account  for  the  major  costs 
of  a  training  p/c/d.  Identification  of  major  costs, 
i.e.,  "cost  drivers,"  would  permit  one  to  focus 
attention  on  areas  for  significant  cost  reduction 
or  for  trade-off  analyses  between  high-cost  items 
and  effectiveness.  It  should  also  assist  in  iden¬ 
tifying  significant  variables  for  use  in  the  devel¬ 
opment  of  cost-estimating  relationships. 

It  would  permit  making  comparisons  of  costs  among 
training  options  that  are  reliable  and  that  can  be 
used  with  confidence. 


III. 


DEFINITIONS  OF  COST  ELEMENTS 
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Definitions  of  the  cost  elements  in  Table  1,  ”A  Compre¬ 
hensive  Cost  Element  Structure  for  Military  Training  Programs, 
Courses,  and  Devices,”  are  presented  in  this  Section.  With  the 
exception  of  the  definitions  of  the  cost  elements  that  pertain 
to  military  and  civilian  personnel,  the  definitions  are  presented 
in  the  order  in  which  they  appear  in  Table  1. 

Military  personnel  and  civilian  employees  of  the  U.S. 
Government  usually  are  associated  with  a  training  p/c/d  through¬ 
out  its  life  cycle.  Accordingly,  the  cost  elements  that  account 
for  their  employment  appear  many  times  under  each  of  the  life- 
cycle  cost  categories  (R&D,  Initial  Investment,  and  Operating 
and  Support)  in  this  CES .  To  avoid  repetition  in  these  defini¬ 
tions,  the  costs  of  military  and  civilian  personnel  are  defined 
first. 

Personnel-associated  costs  are  the  largest  expenditures 
in  most  training  programs  and  courses.  Because  cost-effectiveness 
analyses  often  differ  in  scope  and  context,  not  all  of  these 
cost  elements  or  their  components  will  be  applicable  to  every 
analysis;  thus,  care  should  be  taken  in  the  selection  of  relevant 
costs  in  order  to  avoid  spurious  and  misleading  results. 

Pay  and  Allowances  (P&A): 

Military  pay  and  allowances  are  the  Standard  Composite 
Pav  Rates  presented  and  explicitly  defined  in  the  DoD  "Account¬ 
ing  Guidance  Handbook.”  These  pay  rates  include  basic  pay, 
incentive  and  special  pay,  basic  allowance  for  quarters,  and 
miscellaneous  costs,  each  of  which  is  also  defined  in  the  Hand¬ 
book. 
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Civilian  pay  and  allowances  are  roughly  comparable  to 
military  Standard  Composite  Pay  Rates.  The  Handbook  and  Air 
Force  and  Navy  documents  (Directorate  of  Cost  and  Management 
Analysis  1983,  and  Navy  Personnel  Research  and  Development 
Center  1980)  provide  the  following  breakdown: 

a.  Basic  pay. 

b.  Additional  variable  payments  for  overtime,  holiday 
pay,  night  differentials,  and  cost-of-living  allowances. 

c.  Costs  for  employee  benefits  such  as  quarters  allow¬ 
ance  (when  paid  in  cash),  incentive  awards,  and  the  Service's 
share  of  payments  of  insurance,  retirement,1  FICA,  taxes,  and 
similar  payments. 


Other  Government  Personnel  Costs: 


Military  Personnel: 


PCS:  The  expense  associated  with  a  permanent  change- 
of-station  move,  including  household  goods,  dislocation  allow¬ 
ances,  and  travel  costs. 


TDY:  Includes  transportation  and  per  diem  costs 

incurred  for  (a)  business  travel  associated  with  a  training 
p/c/d,  and  (b)  students  in  attendance  at  short  courses  that  do 
not  require  a  PCS  move. 


Personnel  Replacement:  Includes  the  recurring  costs 
of  acquisition  and  prerequisite  training  of  military  personnel 
who  will  replace. those  now  managing,  operating,  and  supporting 


the  training  p/c/d,  but  who  will  be  transferred  to  other  duties 
or  separated.  Acquisition  costs  include  recruiting  costs  (en¬ 
listed  personnel  only),  in-processing,  and  initial  outfitting. 
"Prerequisite  training"  is  dictated  by  the  skills  required  by 
the  particular  p/c/d(s)  of  interest. 


lThe  Service’s  share  of  civilian  employees'  retirement  pay  equals  the  amount 
contributed  by  the  employees  from  their  basic  pay. 


Health  Care:  This  element  comprises  the  variable  costs 
of  health  care  provided  at  a  higher  echelon  than  operating-base 
level  in  support  of  military  personnel  associated  with  a  train¬ 
ing  p/c/d. 

Transients,  Patients,  and  Prisoners:  This  element  in¬ 
cludes  the  variable  costs  of  the  P&A  of  military  personnel  added 
to  the  Services'  strengths  as  increments  to  the  number  of  per¬ 
sonnel  needed  to  fill  spaces  in  formal  Tables  of  Organization 
and  Equipment.  These  increments  are  needed  because  not  all 
personnel  are  available  in  units  at  all  times.  Transients  are 
personnel  on  PCS  between  units,  patients  are  long-term  hospi¬ 
tal  cases,  and  prisoners  are  personnel  committed  to  detention. 

Family  Housing:  The  net  cost  of  housing  furnished  by 
the  Service  to  the  families  of  military  personnel  associated 
with  a  training  p/c/d.  Net  cost  is  the  difference  between  the 
basic  allowance  for  quarters  (a  component  of  Standard  Composite 
Pay  Rate)  foregone  by  military  personnel  who  occupy  government- 
furnished  family  housing  and  the  Service's  cost  of  that  housing. 

Retirement :  Costs  of  military  retirement  pensions  are 

funded  by  the  DoD,  not  by  the  individual  Services.  The  nature 
of  a  cost-effectiveness  analysis  (i.e.,  "cost  to  the  Service" 
or  "cost  to  the  federal  government")  will  dictate  whether  or 
not  military  retirement  costs  should  be  included. 

Civilian-  Personnel: 

PCS :  (as  for  military  personnel). 

TOY:  (as  for  military  personnel). 

Retirement :  Includes  only  that  portion  of  retirement 

pay  of  civil  service  employees  which  is  funded  from  general 
revenues  of  the  federal  government.  This  element,  therefore, 
is  not  applicable  to  analyses  in  which  costs  are  constrained 
by  Service  or  DoD  budgets,  but  would  be  applicable  if  "cost  to 
federal  government"  is  pertinent. 


A. 


RESEARCH  AND  DEVELOPMENT 


Elements  in  the  Research  and  Development  (R&D)  category 
include  the  costs  of  all  hardware,  software,  other  materials, 
people,  and  facilities  necessary  to  create,  test,  and  evaluate 
a  training  program,  course,  or  device  (or  subsystem  or  major 
modification),  that  is  qualified  to  specifications  and  acceptable 
for  production  (if  hardware  and  software  are  components)  or 
lmplementat ion . 

1.  De s lgn :  The  costs  of  professional  and  technical  per¬ 
sonnel  and  miscellaneous  materials  and  services  required  to 
design  a  training  p/c/d  and  its  components.  Design  activities 
may  include  preliminary  and  detailed  analysis,  the  develooment 
of  performance  and  characteristics  specifications  to  met 
operating  requirements,  the  preparation  of  engineering  drawings, 
and  other  documentation.  The  first  three  phases  of  Instructional 
System  Development  (ISD)  (analysis  of  training  requirements, 
definition  of  training  requirements,  and  development  of  train¬ 
ing  objectives  and  tests)1  are  captured  in  this  element.  ISD 
costs  should  be  separately  identified. 

a.  Pay  and  Allowances:2  The  P&A  of  military  and 
civilian  government  personnel  involved  in  p/c/d  design  and  ISD 
activities  described  above;3  hence,  the  design  function  may 
require  the  services  of  people  such  as  curriculum  developers, 
media  specialists,  subject  matter  experts  and  instructors,  as 
well  as  hardware  and  software  engineers  and  technicians  and 
logistics  specialists. 

b.  Other  Government  Personnel  Costs.2  For  personnel 
whose  P&A  are  included  in  Design  (A.l.a),  above. 


‘Department  of  the  Air  Force,  Instructional  System  Development ,  1975. 

2 Necessary  definitions  of  Pay  and  Allowances  and  Other  Govemme  . j 
Personnel  Costs  are  given  at  the  beginning  of  this  section. 

3Note  that  the  government  personnel  identified  with  most  R&D  functions 
(elements  A.l  through  A. 7)  are  other  than  members  of  the  "System/Project 
Management"  team  whose  costs  are  included  in  element  A. 8. 
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c.  Other ;  The  costs  of  resources,  other  than  govern¬ 
ment  personnel.  Incurred  In  the  design  of  a  training  p/c/d. 

Design  work  by  contractors  and  non-personnel  government  costs 
(e.g.,  purchased  services,  miscellaneous  materials)  are  included. 
The  extent  and  scope  of  the  design  effort  should  dictate  the 
degree  to  which  this  element  is  broken  down. 

2.  Component  Development:  The  costs  to  translate  the 
results  of  design  effort  into  components  of  a  training  p/c/d 
that  meet  design  specifications.  Component  development  includes 
the  planning  for,  and  the  conduct  and  evaluation  of,  component 
tests  (hardware;  systems,  applications,  diagnostic/test,  and 
utility  software  programs,  instructional  and  other  course  mate¬ 
rials;  and  course  tests)  and  the  subsequent  redesign  and  itera¬ 
tion  of  these  activities  until  a  final  design  is  achieved. 

Because  instructional  materials  may  constitute  the 
largest  portion  of  development  cost  for  training  programs  and 
courses  that  are  not  hardware-intensive,  the  costs  of  instruc¬ 
tional  materials  should  be  explicitly  broken  down,  whenever 
possible,  as  costs  of  particular  "media  materials"  and  "software" 
in  the  following  elements  (A. 2. a,  b,  and  c).  Media  materials 
are  those  that  are  to  be  presented  to  students  (e.g.,  slides, 
filmstrips,  workbooks,  video  discs,  cassettes,  movies,  and  any 
nonstandard  equipment,  requiring  R&D,  needed  for  their  presenta¬ 
tion).  Software,  as  a  component  of  instructional  materials,  is 
that  needed  to  present  course  materials,  manage  student  progress, 
and  provide  information  relevant  to  the  management  of  a  course 
and  its  resources.  Note  that  software  as  a  component  of  instruc¬ 
tional  materials  is  distinct  from  other  software  that  might  be 
associated  with  other  training  device  end-items  (e.g.,  the 
software  required  in  the  fire-control  subsystem  of  a  trainer 
aircraft ) . 
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a.  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  government  personnel  involved  in  Component  Develop¬ 
ment  activities,  as  described  above.  These  may  include  the 
people  described  in  Design  (A.l.a),  in  addition  to  develop¬ 
ment  support  (shop)  personnel  and  managers  who  are  identified 
with  specific  components. 

b.  Other  Government  Personnel  Costs:  For  personnel 
whose  P&A  are  included  in  Component  Development  (A. 2. a),  above. 

c.  Other :  Same  as  Design,  Other  (A.l.c),  except  sub¬ 
stitute  "component  development"  for  "design."  In  addition,  non¬ 
personnel  in-house  costs  may  comprise,  for  example,  raw  and 
semi-finished  materials,  purchased  parts  and  GFE  consumed  in 
component  development,  test  equipment,  and  special  tools. 

3.  Produclblllty  Engineering  and  Planning;  The  cost 
incurred  to  insure  the  producibility  of  a  developmental  p/c/d, 
item  or  components  of  hardware  and  software  (e.g.,  video  discs), 
in  an  efficient  and  timely  manner.  ■  Included  are  efforts  related 
to  development  of  quality  assurance  plans  and  special  and  unique 
manufacturing  processes. 

a.  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  government  personnel  involved  in  p/c/d  producibility 
engineering  and  planning.  This  activity  may  require  the  ser¬ 
vices  of  the  people  in  Design  (A.l.a),  above,  as  well  as  quality 
assurance  and  production  engineers  and  technicians. 

b.  Other  Government  Personnel  Costs:  For  personnel 
whose  P&A  are  included  in  Producibility  Engineering  and  Plan¬ 
ning  (A. 3. a),  above. 

c.  Other:  Same  as  Design,  Other  (A.l.c),  above, 
except  substitute  "produc Jbility  engineering  and  planning"  for 
"design. " 
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4.  Tooling:  Includes  the  costs  of  planning,  design, 
fabrication,  assembly,  installation,  modification  and  mainte¬ 
nance  of  the  tools,  fixtures,  inspection  and  test  equipment 
that  support  the  development  of  training  hardware  components. 

Also  includes  the  set  of  software  programs  that  facilitates 
the  development,  test  and  validation  of  applications  software. 

a.  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  government  personnel  involved  in  developmental  tooling, 
as  described  above.  Typically,  these  people  may  include  hard¬ 
ware  component  and  manufacturing  engineers,  computer  engineers 
and  technicians,  curriculum  developers  and  media  specialists, 
and  development  support  personnel. 

b.  Other  Government  Personnel  Costs:  For  personnel 
whose  P&A  are  included  in  Tooling  (A. 4. a),  above. 

c.  Other :  Same  as  Component  Development,  Other  (A.2.c) 
except  substitute  "tooling"  for  "component  development." 

5.  Prototype  Manufacturing:  Includes  the  costs  of  all 
labor  and  materials  specifically  expended  in  the  creation  of  a 
sufficient  number  of  prototypes  of  major  hardware  and  software 
components,  and/or  the  training  system  in  its  entirety,  for  use 
in  pre-acceptance  test  and  evaluation.  The  costs  of  prototype 
spare  parts,  models,  and  mock-ups  are  also  included  in  this 
element . 

a.  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  government  personnel  who  participate  in  producing  and 
integrating  the  prototype  hardware  and  software  for  use  in 
P/C/D  Test  and  Evaluation  (A. 7).  They  may  include  hardware 
and  software  component  engineers  and  technicians,  computer 
engineers  and  programmers,  manufacturing  and  production  engi¬ 
neers  and  specialists,  and  quality  assurance  and  development 
support  personnel. 


tttjv.  it.tj  vr.  r:  ;vw.V  7  V  7  "A  *>  *J>  \V  v  v  v  V  V  . 


".v.v.'s  rrT'>  , 


b.  Other  Government  Personnel  Costs:  For  personnel 
whose  P&A  are  Included  In  Prototype  Manufacturing  (A. 5. a), 
above . 

c.  Other :  Same  as  Component  Development,  Other 
(A.2.c),  except  substitute  "prototype  manufacture"  for  "com¬ 
ponent  development." 

6 .  Data 

a.  Managerial  Data:  Includes  the  costs  of  collecting, 
reproducing,  and  distributing,  throughout  the  R&D  phase, 
reports  and  other  documentation  to  support  both  contractor 

and  Service  program  management.  Excluded  here  are  the  costs 
of  technical  and  analytical  reports  emanating  from  the  Com¬ 
ponent  Development  (A. 2)  and  P/C/D  Test  and  Evaluation  (A. 7) 
functions,  the  costs  of  which  are  Included  In  those  elements. 

(1)  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  government  personnel  who  perform  the  services  described 
In  Data  (A.6.a),  above;  principally,  administrative  support, 
graphics,  and  reproduction  personnel. 

(2)  Other  Government  Personnel  Costs;  For  per¬ 
sonnel  whose  P&A  are  included  in  Data,  Managerial  (A.6.a(l)), 
above . 

(3)  Other :  Same  as  Design,  Other  (A.l.c),  except 
substitute  "managerial  data"  for  "design." 

b.  Technical  Data:  Includes  the  costs  of  preparing, 
reproducing,  and  releasing  to  production,  finalized  engineer¬ 
ing  drawings,  specifications,  technical  manuals,  software  docu¬ 
mentation,  and  test  plans  and  procedures.  The  costs  of  all 
earlier,  iterative  revisions  to  these  data  during  R&D  are 
included  under  Design  (A.l),  Component  Development  (A. 2),  and 
P/C/D  Test  and  Evaluation  (A. 7). 


(1)  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  government  personnel  involved  in  the  preparation  of 
technical  data.  This  activity  may  require  the  diverse  skills 
of  technical  writers,  hardware  and  software  engineers  and 
specialists,  graphic  arts  personnel,  and  logistics  specialists. 

(2)  Other  Government  Personnel  Costs:  For  per¬ 
sonnel  whose  P&A  are  included  in  Data,  Technical  (A.6.b(l)). 

(3)  Other :  Same  as  Design,  Other  (A.l.c),  except 
substitute  "technical  data"  for  "design." 

7.  P/C/D  Test  and  Evaluation:  This  element  comprises 
the  costs  of  resources  dedicated  to  the  preparation,  conduct, 
and  evaluation  of  the  results  of  developmental  tests  of  the 
p/c/d  as  a  whole.1  Also  included  (explicitly  identified)  are 
the  costs  of  completing  the  fourth  phase  of  ISD,  i.e.,  valida¬ 
tion  of  the  efficacy  of  instructional  methods,  media,  devices, 
and  tests.  The  costs  of  component  test  plans  and  tests  and 
the  actual  test  articles  are  excluded  from  this  cost  element; 
they  are  accounted  for  in  cost  elements  A. 2  Component  Develop¬ 
ment,  A. 5  Prototype  Manufacturing,  and  A.6.b  Technical  Data. 

a.  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  government  personnel  who  are  directly  involved  in  the 
test  and  evaluation  (T&E)  of  the  p/c/d  as  a  whole.  The  nature 
of  this  activity  may  require,  to  some  extent,  the  participation 
of  many  of  the  personnel  mentioned  in  elements  A.l  through  A. 6, 
above . 

b.  Other  Government  Personnel  Costs:  For  personnel 
whose  P&A  are  included  in  P/C/D  Test  and  Evaluation  (A. 7. a). 

c.  Other:  The  costs  of  resources,  other  than  govern¬ 
ment  personnel,  procured  for  and/or  utilized  in  the  T&E  of  a 
p/c/d  as  a  whole.  The  costs  of  contractor-conducted  T&E  and 

xThis  element  can  be  equated  to  DT/IOT&E  I  and  II  in  the  development  of  a 
weapon  system. 


non-personnel  government  costs  are  included.  These  government 
costs  may  comprise  new  test  equipment,  consumables,  range  uti¬ 
lization,  purchased  services,  etc. 

8.  System/Project  Management:  This  element  includes  the 
cost  of  technical  and  business  management  effort  expended  by 
both  the  government  and  contractors  in  the  process  of  develop¬ 
ing  an  integrated  training  p/c/d.  Excluded  are  the  management 
costs  that  are  identifiable  with  components  of  a  p/c/d,  and 
which  are  accounted  for  in  all  previous  elements  A.l  through 
A. 7. 

a.  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  government  personnel  involved  in  the  technical  and 
business  management  of*  a  training  p/c/d. 

b.  Other  Government  Personnel  Costs:  For  personnel 
whose  P&A  are  included  in  System/Project  Management  (A. 8. a), 
above. 

c.  Other:  Same  as  Design,  Other  (A.l.c),  except 
substitute  "system/project  management"  for  "design." 

9.  Facllit les :  Includes  the  costs  of  new  building(s), 
modification  and  expansion  of  existing  facilities  or  sites,  and 
facility  maintenance  and  utilities  attributable  to  the  develop¬ 
ment  of  a  training  p/c/d  and/or  its  components.  Since  R&D 
facility  requirements  can  vary  considerably  among  p/c/d’s, 
these  costs  should  be  explicitly  identified.  [Facilities  needed 
for  Implementing  fully  developed  training  p/c/d' s  are  accounted 
for  elsewhere  (element  B.9,  Operational/Site  Activation).] 

10.  Other :  Any  R&D  costs  not  included  above  that  are 
directly  attributable  to,  or  justifiably  allocable  to  the  train¬ 
ing  p/c/d  or  its  components  should  be  identified  and  Included 
here.  Examples  might  be  contractor  General  and  Administrative 
expenses  and  fees,  license  fees,  and  incentive  payments  and,  if 
consequential,  base  operating  support  and  military  family  housing. 
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B.  INITIAL  INVESTMENT 


Elements  in  the  Initial  Investment  category  comprise  the 
one-time  costs  of  procuring  and  deploying  p/c/d  resources  Ln 
the  quantities  needed  to  satisfy  anticipated  requirements 
(including  attrition  and  wear-out). 

1 .  Production 

a.  Nonrecurring:  This  group  of  elements  comprises 
the  costs  of  engineering  and  capitalization  necessary  to  pre¬ 
pare  for  production  of  a  training  device1  or  components  of  a 
p/c/d  at  the  rates  and  total  quantity  anticipated. 

(1)  Production  Planning:  The  cost  of  engineering 
(and  other  technical)  effort  to  determine  the  requirements  for 
types  and  quantities  of  production  tooling,  equipment,  quality 
assurance  and  production  control  procedures,  make-or-buy  deci¬ 
sions,  and  physical  plant. 

(2)  Production  Tooling  and  Equipment:  Includes 
the  cost  of  purchasing,  fabricating,  and  installing  the  tools, 
jigs  and  fixtures,  test  equipment,  etc.,  to  support  the  manu¬ 
facture  of  the  hardware  and  software  of  a  complete  training 
device  or  p/c/d  components. 

(3)  Industrial  Facilities:  Includes  the  costs 
of  new  bulldlng(s),  modification  and  expansion  of  existing 
facilities,  and  the  acquisition  of  real  estate  for  the  produc¬ 
tion  of  a  training  device  or  components  of  a  p/c/d. 

(4)  Other :  Any  other  nonrecurring  costs  attribut¬ 
able  to,  or  justifiably  allocable  to,  production  of  a  training 
device  or  components  of  a  p/c/d  should  be  identified  and 
included  here. 


b.  Recurring:  Elements  in  this  group  include  the 
costs  of  activities  and  materials  necessary  to  produce  units 
of  a  training  device  or  p/c/d  components  in  the  quantities 
required. 

(1)  Manufacturing:  The  costs  of  labor,  materials 
[including  Government-Furnished  Equipment  (GFE)],  overhead,  and 
any  other  charges  incurred  in  the  fabrication  and  assembly  of 
p/c/d  components  (hardware  and  software),  and  integration  of 
complete  units. 

(2)  Sustaining  Engineering:  Comprises  the  cost 
of  all  engineering  effort  performed  in  support  of  production, 
including  maintainability/reliability  engineering,  value  en¬ 
gineering,  production  engineering,  logistics  engineering,  and 
any  other  support  engineering  effort  directly  involved  with 
production  of  p/c/d  components  or  a  training  device  as  a  whole 
[e.g.,  the  maintenance,  modification  and  updating  of  technical 
data,  and  the  preparation  of  Engineering  Change  Proposals  (ECP) 
and  Engineering  Change  Orders  (ECO)]. 

(3)  Sustaining  Tooling:  The  cost  of  maintenance, 
replacement  or  modification  of  tools,  test  equipment,  and 
diagnostic/test/system  software  programs  after  the  start  of 
production. 

(4)  Quality  Assurance:  The  cost  of  implementing 
the  controls  necessary  to  insure  that  manufacturing  processes 
produce  p/c/d  components  that  meet  prescribed  standards.  In¬ 
cluded  are  costs  of  receiving,  in-process  and  final  inspections 
of  materials,  parts,  assemblies,  software;  reliability  testing, 
statistical  analysis  and  related  reports;  and  the  conduct  of 
production  acceptance  tests. 

(5)  Other:  Any  other  costs  identifiable  with,  or 
justifiably  allocable  to,  recurring  production  of  components 
and/or  a  p/c/d  as  a  whole. 
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c.  Initial  Spares  and  Repair  Parts;  The  cost  of 
spare  components,  subassemblies  and  repair  parts  produced  in 
the  early  stages  of  production  for  the  maintenance  of  major 
end-items  of  p/c/d  hardware  and  software  until  a  normal  flow 
of  replenishment  spares  is  established  in  the  logistics  pipe¬ 
line  . 

2.  Engineering  Changes:  Includes  the  costs  of  manufac¬ 
turing,  tooling  and  quality  assurance  labor,  materials,  and 
overhead  to  effect  approved  alterations  to  a  training  p/c/d 
and/or  its  components  while  it  is  still  in  the  process  of  manu¬ 
facture.  The  engineering  costs  incurred  in  preparing  such 
changes  are  covered  above  in  cost  element  B.l.b(2),  Sustaining 
Engineering. 

3.  Purchased  P/C/D-Peculiar  Equipment:  Includes  the 
costs  of  secondary  end-items  purchased  from  vendors  (e.g., 
peculiar  support  equipment,  automatic  test  equipment  software, 
or  accessories).  Such  items  are  excluded  from  consideration 
in  elements  B.l.a(2),  Production  Tooling  and  Equipment  and 
B.l.b(l),  (2),  and  (3)j  certain  Recurring  Production  costs. 

4.  Common  Equipment:  The  cost  of  equipment  usable  for 
systems  other  than  the  p/c/d  being  costed  but  essential  to  its 
operation.  For  training  p/c/d's,  common  equipment  may  include 
the  costs  of,  e.g.,  additional  desks,  carrels,  motion  picture 
projectors,  and  some  types  of  computers  needed  to  support  its 
use . 


5 .  Data:  • 

a.  Managerial  Data:  Includes  the  costs  of  collecting, 
reproducing,  and  distributing,  throughout  the  Initial  Investment 
phase,  reports  and  other  documentation  to  support  both  contrac¬ 
tor  and  Service  program  management. 

(1)  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  government  personnel  who  perform  the  services  described 
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%  in  Managerial  Data,  B.5.a,  above;  principally,  administrative 

^  support,  graphics  and  reproduction  personnel. 

9  (2)  Other  Government  Personnel  Costs:  For  per¬ 

sonnel  whose  P&A  are  included  in  Managerial  Data,  B.5.a  (1). 


(3)  Other :  The  costs  of  resources,  other  than 
government  personnel,  incurred  in  producing  managerial  data 
for  a  training  p/c/d.  Contractor-produced  managerial  data  and 
non-personnel  government  costs  (e.g.,  purchased  services,  mis¬ 
cellaneous  materials)  are  included. 

b.  Technical  Data:  Includes  the  costs  of  revising, 
reproducing  in  the  quantities  required  for  training  p/c/d  im¬ 
plementation,  and  distributing  technical  publications  (e.g., 
technical  orders,  handbooks,  manuals,  and  software  documenta¬ 
tion)  for  use  in  the  field. 

(1)  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  government  personnel  involved  in  the  preceding  activ¬ 
ities.  (Production  and  revision  of  technical  data  by  con¬ 
tractor^)  would  minimize  government  P&A.) 

(2)  Other  Government  Personnel  Costs:  For  per¬ 
sonnel  whose  P&A  are  included  in  Technical  Data,  B.5.b  (1),  above 

(3)  Other:  Same  as  Managerial  Data,  Other,  B.5. 

a  (3)>  except  substitute  "technical  data"  for  "managerial  data." 


j  c.  Instructional  Materials:  Comprises  the  costs  of 

!  updating,  reproducing  in  the  quantities  required  for  training 

course  implementation,  and  distributing  instructional  informa- 
J  tion,  tests,  and  guidance  for  instructors.  Whenever  possible, 

1  instructional  material  costs  should  be  explicitly  broken  down 

as  "media  materials,"  "courseware,"  and  "software."  (See 
;  discussion  under  "Component  Development,"  element  A. 2.) 

S  (1)  Pay  and  Allowances:  The  P&A  of  military  and 


civilian  government  personnel  involved  in  the  activities 
described  immediately  above.  Updating  of  instructional  materials 
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may  require  the  services  of  people  such  as  media  and  subject 
matter  experts  and  software  specialists. 

(2)  Other  Government  Personnel  Costs:  For  per¬ 
sonnel  whose  P&A  are  In  included  in  Data,  Instructional  Mate¬ 
rials,  B.5.C  (1). 

(3)  Other:  Same  as  Managerial  Data,  Other,  B.5. 
a  (3),  except  substitute  "instructional  materials"  for  "mana¬ 
gerial  data." 

6.  Training  P/C/D  Test  and  Evaluation:  This  element 
applies  to  the  p/c/d  as  a  whole.  It  includes  the  costs  of  all 
resources  required  to  prepare  for,  conduct,  and  evaluate  the 
results  of  T&E  performed  by  the  Service  only.1  The  costs  of 
complete  unit(s)  of  a  p/c/d  and  necessary  test  equipment  for 
this  T&E  are  included  here  only  if  it  was  not  built  and 
accounted  for,  previously,  in  Research  and  Development  (ele¬ 
ments  A. 5,  Prototype  Manufacturing,  and  A. 7,  P/C/D  Test  and 
Evaluation). 

a.  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  government  personnel  who  are  directly  involved  in  the 
T&E  of  the  p/c/d  as  a  whole.  The  nature  of  this  activity  may 
require,  to  some  extent,  the  participation  of  people  with 
skills  similar  to  those  mentioned  in  R&D  elements  A.l  through 

A.  6,  and  Initial  Investment  elements  Sustaining  Engineering, 

B. l.b  (2),  Managerial  Data,  B.5.a  (1),  and  Instructional  Mate¬ 
rials,  B.5.c  (1). 

7.  System/Project  Management:  Costs  incurred  during 
the  Initial  Investment  phase  for  continuing  the  same  functions 
costed  in  System/Project  Management,  A. 8  under  Research  and 
Development . 
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^is  T&E  activity  approximates  DT/OT  III  for  a  weapon  system. 

37 


a.  Pay  and  Allowances: 


b .  Other  Government  Personnel  Costs: 

c .  Other : 

8.  Rents :  The  costs  of  leasing  equipment,  communications 
circuits,  services,  or  material  as  part  of  the  Initial  Invest¬ 
ment  needed  to  establish  a  training  p/c/d. 

9.  Operational/Site  Activation:  This  element  includes 
the  costs  of  real  estate,  construction,  conversion,  utility 
provisions  and  plant  equipment  needed  at  organizational  and 
intermediate  levels  to  house,  service  and  operate  the  training 
p/c/d.  Depot-level  facilities  are  excluded. 


10.  Initial  Training: 

a.  Instructors :  The  cost  of  training  the  initial 
group  of  instructors  who  will  train  other  instructors  to  imple¬ 
ment  and  maintain  a  new  or  modified  p/c/d.  Included  are  the 
Pay  and  Allowances  and  Other  Government  Personnel  Costs  for 
instructors  and  student-instructors,  and  special  instructional 
materials  needed  during  the  period  of  initial  training. 

b.  Maintenance  Personnel:  The  cost  of  training  a 
cadre  of  personnel  to  maintain  a  new  or  modified  training  p/c/d 
at  all  echelons  (organizational,  intermediate,  and  depot  levels). 
Included  are  the  Pay  and  Allowances  and  Other  Government  Per¬ 
sonnel  costs  of  these  trainees,  and  the  special  instructional 
materials  required. 


Transporation : 


a.  First -Destination:  Includes  the  costs  of  moving 
components  of  a  training  p/c/d  and  its  associated  equipment 
from  point  of  manufacture  to  Continental  U.S.  (CONUS)  point 
of  entry  into  the  government’s  logistic  network. 
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b.  Second-Pest lnatlon :  Includes  the  costs  of  moving 
components  of  a  training  p/c/d  from  CONUS  point  of  entry  into 
the  government's  logistic  network  to  operational  sites  either 
in  the  U.S.  or  overseas. 

12.  Other :  Includes  costs  not  captured  in  the  foregoing 
elements  that  are  identifiable  with,  or  justifiably  allocable 
to,  the  Initial  Investment  phase  of  a  training  p/c/d.  Such 
costs  should  be  individually  enumerated. 
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C.  OPERATING  AND  SUPPORT 

Elements  in  the  Operating  and  Support  (O&S)  category 
include  the  continuing  costs  of  managing,  operating,  and 
maintaining  units  of  a  training  p/c/d  after  they  have  been 
deployed  for  their  intended  use.  Elements  are  grouped,  by 
function,  as  direct  and  indirect  costs. 

1.  Direct  Costs:  Elements  in  this  group  include  the 
costs  for  resources  that  are  specifically  identified  with, 
and  involved  in,  the  operation,  maintenance,  and  management 
of  a  particular  training  p/c/d . 

a.  Instructional  Costs:  The  expenses  incurred  in 
conducting  a  particular  course  of  instruction  which  are 
directly  identified  with  teaching,  supervision,  and  administra¬ 
tion  at  the  course  level,  and  the  operation,  maintenance  and 
periodic  modification  of  course-dedicated  training  devices 
and  equipment . 

(1)  Pay  and  Allowances:  The  P&A  of  government 
personnel  involved  in  the  instructional  activities  described 
in  Instructional  Costs,  C.l.a,  above.  Necessary  definitions 
are  given  at  the  beginning  of  this  section. 

(a)  Instructors :  The  P&A  of  military  and 
civilian  instructors  for  the  time  they  devote  to  a  particular 
training  program  or  course. 
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(b )  Supervisory,  Administrative,  and  Support 

Personnel :  Same  as  (a),  preceding,  for  supervisory,  admini¬ 

strative,  and  support  personnel  at  the  program  or  course 
level. 

(c)  Maintenance  Personnel:  The  P&A  of  mili¬ 
tary  and  civilian  personnel  for  the  time  they  dedicate  to  the 
repair,  modification,  and  routine  maintenance  of  training 
device  and  equipment  hardware.  Note  that  this  cost  element 
pertains  to  organizational  and  intermediate  levels  of  mainte¬ 
nance;  depot  maintenance  is  the  subject  of  element  C.l.a  (6). 

(2)  Other  Government  Personnel  Costs:  For  per¬ 
sonnel  whose  pay  and  allowances  are  included  in  Direct, 
Instructional  Costs,  C.l.a  (1),  above.  Necessary  definitions 
are  given  at  the  beginning  of  this  section. 

(3)  Consumption : 

(a)  Petroleum,  Oils,  and  Lubricants  (POL): 

The  costs  of  fuels  and  lubricants  needed  for  operating  course- 
dedicated  training  devices  and  equipment. 

(b)  Training  Munitions:  The  cost  of  ammuni¬ 
tion,  bombs,  missiles,  etc.,  allocated  to  a  training  course 
for  expenditure. 

(c)  Utilities: 

.1.  Electric  Power:  The  cost  of  electric 
power  needed  to  operate  training  devices  and  equipment,  and 
for  special  requirements  such  as  air  conditioning  for  computer 
equipment . 

2.  Other :  As  required. 

(d)  Instructional  Materials:  The  costs  of 
replenishing  stocks  of  texts,  workbooks,  films,  supplies,  and 
other  materials  used  by  instructors  and  students  in  a  train¬ 
ing  course. 
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(4)  Replenishment  Spares:  The  cost  of  spare 
components  and  assemblies  procured  to  maintain  required  stock 
levels  in  support  of  training  devices  or  major  end-items  of 
equipment  during  the  operational  phase  of  a  training  p/c/d 's 
life  cycle. 

(5)  Modification  Materiel:  Includes  the  cost  of 
items  of  materiel  procured  for  the  purpose  of  modifying  train¬ 
ing  devices  and  equipment  after  acceptance  by  a  military  ser¬ 
vice.  Labor  costs  for  effecting  modifications  are  excluded; 
they  are  covered  by  elements  Maintenance  Personnel,  C.l.a  (l)(c). 
Other  Government  Personnel  Costs,  C.l.a  (2),  and  Labor  and 
Materials,  C.l.a  (6)(a). 

(6)  Depot  Maintenance; 

(a)  Labor  and  Materials:  Includes  the  cost 
of  military  and  civilian  labor  and  miscellaneous  materials  for 
the  repair,  overhaul  and  modification  of  training  device  and 
equipment  components  and  subsystems.  Both  organic-  and 
contractor-performed  depot  maintenance  are  applicable  here. 

(b)  Second-Destination  Transportation:  The 
cost  of  transportation  of  training  devices,  equipment,  and 
their  components  and  subsystems,  between  depot  maintenance 
facilities  and  training  installations. 

(c)  Other:  As  required. 

(7)  Other  Purchased  Services:  The  costs  of  leasing 
equipment,  land,  communications  circuits,  contractor  services 
(other  than  depot  maintenance),  and  material  that  are  specifi¬ 
cally  identifiable  with  a  particular  program  or  course  of 
instruction . 

(8)  Other :  This  element  may  include  the  costs  for 
any  other  resources  that  are  not  designated  in  Direct,  Instruc¬ 
tional  Costs,  C.l.a  (1)  through  (7),  but  which  would  be 
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consistent  with  the  preceding  definition  of  Instructional 
Costs.  Such  costs  should  be  explicitly  identified. 

b.  Training  Activity  Costs;  The  expenses  incurred 
at  the  training  activity  (i.e.,  school  or  center  headquarters) 
level  for  resources  that  are  required  for  the  management, 
administration,  and  other  support  of  a  number  of  courses, 
among  which  are  the  alternatives  subject  to  cost-effectiveness 
analysis . 

(1)  Pay  and  Allowances:  The  P&A  equivalent  to 
the  time  devoted  to  a  particular  training  program,  course,  or 
device  by:  the  training  activity  commander  and  his  immediate 
staff;  personnel  involved  in  functions  such  as  student  control 
and  administration;  flight  safety,  range  maintenance,  meteo¬ 
rology,  communications,  instructor  training,  and  planning, 
programming,  and  resource  management;  and  specialists  who 
periodically  review  training  standards,  evaluate  course  con¬ 
tent  and  results,  improve  training  aids,  and  perform  other 
course-associated  services.1  For  courses  in  which  modifica¬ 
tion  of  software  and/or  courseware  is  significant  (e.g., 
computer-based  instruction),  the  P&A  of  software/courseware 
specialists  should  be  identified  explicitly. 

(2)  Other  Government  Personnel  Costs:  For  per¬ 
sonnel  whose  P&A  are  included  in  Training  Activity  Costs, 

C.l.b  (1),  above.  Necessary  definitions  are  given  at  the 
beginning  of  this  section. 

(3)  Other:  Includes  the  costs  of  resources  at 
the  training  activity  level,  other  than  government  personnel, 
that  are  incurred  because  a  particular  program  or  course  is 
conducted  within  the  training  activity. 


l0ngoing  Improvement  of  course  content  is  the  final  phase  of  ISD.  It 
includes  continuing  evaluation,  revision  to  reflect  the  results  of 
evaluation,  and  periodic  modification  of  software  and  courseware  to 
accorrmodate  changes  in  training  requirements. 
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(a)  Consumables :  Includes  the  costs  of  general 
supplies,  common  training  aids,  utilities,  and  other  similar 
items  that  are  expended  by  the  school  or  center  headquarters  in 
direct  support  of  a  program  or  course. 

(b)  Other:  The  costs  of  purchased  services, 
leased  equipment,  and  any  other  resources  not  specified  in  the 
preceding  elements  of  Training  Activity  Costs,  C.l.b,  that  are 
incurred  at  the  training  activity  level  for  the  conduct  of  a 
particular  training  p/c/d. 

c.  Airfield  and  Carrier  Operations:  This  element 
covers  only  the  costs  incurred  for  airfield  and  carrier  opera¬ 
tions  that  are  traceable  to  the  conduct  of  a  particular  train¬ 
ing  program  or  course.  Airfield  and  carrier  operations  include 
functions  such  as  flight  line  communications,  air  traffic  con¬ 
trol,  emergency  services,  aircraft  security,  and  navigation 
aids . 

(1)  Pay  and  Allowances:  That  portion  of  the  P&A 
of  military  and  civilian  personnel  assigned  to  airfield  and 
carrier  operations  that  is  attributable  to  a  particular  train¬ 
ing  p/c/d. 

(2)  Other  Government  Personnel  Costs:  For  per¬ 
sonnel  whose  P&A  are  included  in  Airfield  and  Carrier  Opera¬ 
tions,  C.l.c  (1),  above. 

(3)  Other:  Non-personnel  costs  incurred  for  air¬ 
field  and  carrier  operations  that  are  justifiably  attributable 
to  a  particular  training  program  or  course. 


d.  Student  Costs:  The  personnel-associated  costs  of 
U.S.  military  and  civilian  personnel  in  training  status. 

(1)  nay  and  Allowances:  The  Standard  Composite 
pay  rates  of  the  students.  Necessary  definitions  are  given 
at  the  beginning  of  this  section. 


(2)  Other  Government  Personnel  Costs:  For  per¬ 
sonnel  whose  P&A  are  included  in  Airfield  and  Carrier  Operations, 
C.l.c  (1),  above. 

(3)  Other :  Non-personnel  costs  incurred  for  air¬ 
field  and  carrier  operations  that  are  justifiably  attributable 
to  a  particular  training  program  or  course. 

d.  Student  Costs:  The  personnel-associated  costs  of 
U.S.  military  and  civilian  personnel  in  training  status. 

(1)  Pay  and  Allowances:  The  Standard  Composite 
pay  rates  of  the  students.  Necessary  definitions  are  given  at 
the  beginning  of  this  section. 

(2)  Other  Student  Costs:  For  U.S.  military  and 
civilian  students.  Applicable  costs  are  defined  under  "Other 
Government  Personnel  Costs"  at  the  beginning  of  this  section. 

e.  Other  Direct  Costs:  This  element  is  to  include 
any  direct  operating  and  support  costs,  not  accounted  for 
above,  that  are  attributable  to  the  existence  of  the  training 
p/c/d's  of  interest.  Costs  included  in  this  element  should  be 
explicitly  identified. 

2.  Indirect  Costs:  Elements  in  this  group  include  the 
costs  that  may  be  incurred  for  resources  which,  although  essen¬ 
tial  to  support  a  particular  training  p/c/d,  are  not  directly 
involved  in  its  operation,  maintenance,  or  management. 

a.  Base  Operations:  Includes  the  costs  incurred  by 
a  host  installation  because  a  training  program  or  course  is 
located  on  that  base.  Examples  of  such  activities  are  mainte¬ 
nance  and  utility  costs  for  living  quarters  and  mess  facilities 
for  individuals,  transportation,  supply,  laundry,  recreation, 
safety  and  jecurlty,  and  medical  services.  Military  family 
housing  is  excluded  here  (see  Military  Family  Housing  Support, 
C.2.c)  . 
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(1)  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  personnel  assigned  to  base  operations  activities  in 
support  of  a  particular  training  program  or  course. 

(2)  Other  Government  Personnel  Costs:  For  per¬ 
sonnel  whose  pay  and  allowances  are  included  in  Base  Operations, 
C.2.a  (1),  above. 

(3)  Other:  Non-personnel  costs  incurred  by  a  host 
installation  that  are  traceable  to  the  location  of  a  particular 
training  p/c/d  on  that  base. 

b.  Inventory  and  Supply  Management:  Includes  the 
costs  incurred  above  base  level  for  ordering,  stocking  and 
distributing  items  of  training  p/c/d-associated  hardware,  soft¬ 
ware,  courseware,  and  items  that  are  required  to  support  the 
military  personnel  identified  with  a  p/c/d. 

(1)  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  personnel  who  are  engaged  in  the  above  activities  at 
theater  and  depot  levels. 

(2)  Other  Government  Personnel  Costs:  For  per¬ 
sonnel  whose  P&A  are  included  in  Pay  and  Allowances,  C.2.b  (1), 
above . 


(3)  Other:  As  required. 

c.  Military  Family  Housing  Support:  Includes  the  net 
costs1  of  managing,  operating  and  maintaining  government  housing 
occupied  by  families  of  military  personnel  associated  with  the 
conduct  of  a  particular  training  program  or  course. 

(1)  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  personnel  devoted  to  the  functions  described  in  the 
preceding  paragraph. 


*Net  cost  is  the  difference  between  actual  cost  and  reimbursements  pro¬ 
vided  by  military  personnel  via  forfeiture  of  basic  allowance  for  quarters, 
which  is  a  component  of  Pay  and  Allowances. 


(2)  Other  Government  Personnel  Costs:  For  per¬ 
sonnel  whose  P&A  are  included  in  Housing  Support,  C.2.c  (1), 
above . 

(3)  Other :  Non-personnel  costs  (purchased  services, 
materials,  etc.)  incurred  for  the  operation  and  maintenance  of 
family  housing  occupied  by  military  personnel  associated  with 
the  conduct  of  a  training  program  or  course. 

d.  Command  Support  Costs: 1  The  costs  of  managerial 
support  provided  by  major  or  intermediate  command  headquarters 
that  are  identifiable  with  a  particular  training  p/c/d.  These 
costs  should  include  an  appropriate  share  of  the  installation 
support  provided  to  the  command  headquarters. 

(1)  Pay  and  Allowances:  The  P&A  of  military  and 
civilian  personnel  at  command  headquarters  whose  efforts  are 
devoted  wholly,  or  in  part,  to  an  individual  training  p/c/d, 
and  to  an  appropriate  share  of  headquarters  installation 
support . 

(2)  Other  Government  Personnel  Costs:  For  per¬ 
sonnel  whose  P&A  are  included  in  Command  Support,  C.2.d  (1), 
above . 

(3)  Other;  Non-personnel  costs  (purchased  ser¬ 
vices,  materials,  etc.)  incurred  by  command  headquarters  that 
are  indentifiable  with  support  of  a  particular  training 
p/c/d  and  an  appropriate  share  of  headquarters  installation 
support . 


lrIhe  Cost  Analysis  Improvement  Group,  OSD,  advises  the  exclusion  of  Com¬ 
mand  Structure  Overhead,  which  includes  personnel  assigned  to,  and  the 
upkeep  costs  of,  "...operating  headquarters  and  staffs  at  and  above  the 
level  of  numbered  Army,  Air  Force  Air  Division,  Naval  Air  Wing,  and  Fleet 
Marine  Force...."  It  is  assumed  that  the  resources  of  these  headquarters 
would  not  vary  perceptibly  with  the  addition  or  deletion  of  the  individual 
training  p/c/d(s)  under  consideration. 
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e.  Other  Indirect  Costs:  This  element  is  for  any 
indirect  operating  and  support  costs,  not  accounted  for  above, 
that  are  attributable  to  the  existence  of  the  training  p/c/d(s) 
of  interest.  Costs  included  here  should  be  explicitly  identified. 
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IV.  APPLICATION  OF  PROPOSED  COST  ELEMENT  STRUCTURE 
TO  TRAINING  PROGRAMS,  COURSES,  AND  DEVICES 


Table  2  was  prepared  to  illustrate  the  applicability  of 
each  cost  element  in  Table  l1  to  three  types  of  training 
evaluated  in  previous  studies,  i.e.,  the  cost-effectiveness 
of  flight  simulators,  computer-based  instruction, and  mainte¬ 
nance  simulators.  The  applicability  of  each  cost  element  to 
each  type  of  training  was  estimated  as  follows: 


ADDlicability  of  Cost  Element 
Always  applicable. 

May  be  applicable,  depending  on  the 
context  of  the  problem  presented, 
assumptions,  ground  rules  for  the 
analysis,  and  characteristics  of 
the  training  p/c/d  of  interest. 

Not  applicable. 


Symbol 

+ 


(blank) 


As  should  be  expected,  some  functions  and  resources,  and 
the  costs  associated  with  them,  are  essential  to  all  training 
systems  and,  regardless  of  their  size  or  complexity,  certain 
costs  would  always  be  incurred.  These  include,  for  example, 
p/c/d  design,  test  and  evaluation,  system/project  management. 


Discrimination  between  military  and  civilian  personnel,  although  an 
Important  characteristic  of  Table  1,  is  omitted  from  Table  2  because 
it  is  not  essential  to  illustrate  the  general  applicability  of  this 
cost  element  structure. 


» * 

Table  2.  ILLUSTRATIVE  APPLICATION  OF  THE  COMPREHENSIVE  COST  ELEMENT 

STRUCTURE  FOR  MILITARY  TRAINING  PROGRAMS,  COURSES,  AND  DEVICES 


COST  CATE60RIES/ELEMENTS 


A.  RESEARCH  ANO  DEVELOPMENT 

1.  Design 

2.  Component  Development 

3.  ProducttriNty  Engineering 
end  Plenning 

4.  Teeing 

5.  Prototype  Manufacturing 

6.  OaTO 

a.  Managerial 

b.  Technical 

7.  P/C/O  Teat  and  Evaluation 
S.  System /Project  Management 
9.  Facilities 

10.  Other 

B.  INITIAL  INVESTMENT 

1.  Production 

a.  Nonrecurring 

(1)  Production  Planning 

(2)  Production  Tooling 
and  Equipment 

(3)  Industrial  Facilities 

(4)  Others 

b.  Recurring 

(1)  Manufacturing 

(2)  Sustaining  Engineering 

(3)  Sustaining  Toeing 

(4)  Quality  Assurance 

(5)  Other 

c.  Initial  Spares  and 
Repair  Parts 

2.  Engineering  changes 

3.  Purchased  P/C/O-Pecullar 


ACADEMIC  TRAINING 


INDIVID-  I  COMPUTER-BASED 
UALIZED 


(NO  COMPUTERS) 


TR'MI 

■rau 


MAINTENANCE 

TRAINING 


ACTUAL 

EQUIP-  SIMU- 
MENT  LATOR* 


FLIGHT  TRAINING 


AIRCRAFT 


TRAINER*1 


4.  Common  Equipment 

5.  Data 

a.  Managerial 

b.  Technical 

c.  Instruction  Materials 

S.  P/C/D  Test  and  Evaluation 

7.  Systam/Pnjoct  Management 

8.  Rents 

9.  Operatienal/Sita  Activation 


’Assumes  now  hardware  and/or  software 
b0eslgnod,  produced,  and  operand  as  a  trainer. 

cEssontla(y  operational  configuration  and  performance.  May  ba  used  In  primary  mission  rola  but  used  as  trainer. 
+  "Applicable 

•  "May  ba  applicable  dapandant  upon  contest  of  problem  presented,  assumptions,  and  system  characteristics. 
(Blank)- Not  applicable 


Table  2  (continued) 


COST  CATEGORIES/ELEMENTS 


10.  tu«al  Training 
s.  Instructors 

b.  Maintenance  Personnel 

11.  Transportation 

a.  First  Oesttaatieu 

b.  Sacand  Destination 

12.  Ottiar 

C.  OPERATING  ANO  SUPPORT 
1.  Oiract  Calls 
a.  Instructional  Casta 

(1)  Pay  and  ARawancas 

(a)  Instructors 

(b)  Supervisors, 
Administrative 
and  Suppart 
Parian  nai 

(c)  Mabitananca 


ACADEMIC  TRAINING 


CONVEN-  INDIVID-  I  COMPUTER-BASE 
nONAl  UALIZEO 


(NO  COMPUTERS) 


MAINTENANCE 

TRAINING 


ACTUAL 

EQUIP- 


FLIGHT  TRAINING 


AIRCRAFT 


SIMU¬ 

SIMU¬ 

LATOR* 

TRAINER1* 

TIONAL* 

LATOR* 

+ 

♦ 

+ 

♦ 

♦ 

+ 

♦ 

+ 

♦ 

♦ 

+ 

(2)  Otbar  Government 
Parian  Ml  Casts 

(3)  Consumption 

(a)  POL 

(b)  Training 
Munitions 

-  (c)  Utilities 
1  Elactrte 


2  Otbar  ...  •  . 

(d)  Instructional 

Materials  +  +  +  +  + 

(a)  Otbar  ...  •  • 

(4)  Replenishments 

Spares  +  +  + 

(5)  Modification  Material  •  •  • 

(6)  Depot  Maintenance  •  •  • 

(a)  Labor  and 

Materials  •  •  • 

(b)  Sacand- Destina¬ 

tion  transpor¬ 
tation  •  •  • 

(c)  Other  •  •  • 

(7)  Other  Purchased 

Services  ...  •  . 

(S)  Other  ...  •  • 

b.  Training  Activity  Casts 

(1)  Pay  and  ARawancas  +  +  +  +  + 

’Assumes  new  hardware  and/or  software 
•’Designed,  produced,  and  operated  as  a  trainer. 

eEssantlaRy  operational  configuration  and  perfermanco.  May  ba  used  In  primary  million  role  but  usod  at  trainer. 
+  ■  Applicable 

•  ■May  ba  appRcabie;  dependant  upon  contest  of  problem  presented,  assumptions,  and  system  characteristics. 
(Blank)<.  Not  appucable. 

1  a-e-aa-i  7 


Table  2  (continued) 


COST  CATEGORIES/ELEMENTS 


ACAOEMIC  TRAINING 


COMPUTER-RASE 


(NO  COMPUTERS)  ASSISTEO  MANAGEO 


MAINTENANCE 

TRAINING 


ACTUAL 


FLIGHT  TRAINING 


AIRCRAFT 


instructional  materials,  initial  training  of  instructors,  base 
operations,  students,  instructors,  and  other  management  and 
support  personnel. 

Other  functions  and  resources,  however,  are  required  for 
some,  but  not  all,  new  training  programs,  courses,  or  devices. 
For  example,  initial  investment  costs  associated  with  hardware 
and  software  production  (e.g.,  manufacturing,  sustaining  engi¬ 
neering,  tooling,  and  quality  control)  apply  to  simulators  and 
aircraft  designed  exclusively  for  training,  but  are  not  appli¬ 
cable  to  conventional  and  individualized  instruction  in  which 
computers  are  not  utilized. 

This  degree  of  applicability  (symbol  •),  indicating  that  a 
cost  element  may  or  may  not  be  applicable,  is  liberally  assigned 
This  is  consistent  with  its  definition.  For  example,  the  cost 
of  training  munitions  [element  C.l.a(3)(b)]  is  applicable  in 
individualized  markmanshlp  training  of  combat  troops,  but  may 
not  be  applicable  in  the  academic  training  of  zone-of-interior 
radar  operators.  Another  example  applies  to  several  elements 
in  the  R&D  .category  for  operational  aircraft  used  as  trainers. 
Whether  significant  costs  would  be  incurred  for  component 
development,  producibility  engineering  and  planning,  tooling, 
and  prototype  manufacture  would  depend  upon  the  degree  to  which 
operational  aircraft  would  be  modified  for  training  purposes. 

Although  we  acknowledge  that  the  assessment  of  degree  of 
applicability  in  Table  2  is,  in  part,  judgmental,  the  table 
shows  that  a  common  cost  element  structure  can  be  applied  to 
the  broad  range  of  training  programs,  courses,  and  devices. 


V.  DISCUSSION 


The  main  need  for  a  definitive  cost  element  structure 
relevant  to  military  training  is  to  enable  consistent  and 
credible  evaluations  of  the  cost  and  effectiveness  of  military 
training  programs,  courses,  and  devices.  Once  the  costs  can 
be  specified  and  effectiveness  measured  or  predicted,  cost- 
effectiveness  ratios  can  be  computed  for  alternative  training 
p/c/d ' s . 

We  have  already  pointed  out  that  the  level  of  detail  in 
this  structure  permits  people  with  interests  in  different 
aspects  of  training  to  focus  on  cost  elements  of  primary  con¬ 
cern  to  them.  It  must  be  noted,  however,  that  attempts  to' 
optimize  among  selected  cost  elements  without  regard  to  related 
cost  elements  in  the  same,  or  other,  cost  categories  can  result 
in  misleading  conclusions.  The  following  examples  illustrate 
the  importance  of  carefully  considering  the  impact  of  all  costs 
attributable  to  a  training  system,  throughout  its  life  cycle, 
even  though  it  may  not  appear  necessary  to  do  so  to  answer  a 
particular  question. 

Consider,  for  example,  two  ways  of  providing  images  of 
the  outside  world  in  a  flight  simulator  or  a  tank  gunnery 
simulator.  Assuming  that  both  techniques  were  equally  satis¬ 
factory  and  the  immediate  concern  was  restraint  in  procurement 
costs  (i.e.,  elements  of  the  Initial  Investment  cost  category), 
a  decision  might  be  made  in  favor  of  the  alternative  with  the 
lower  purchase  price.  Over  the  system’s  life  cycle,  however, 
the  alternative  that  would  result  in  lower  procurement  cost 


might  prove  to  be  more  costly  if  reliability  were  lower, 1  if 
electric  power  consumption  were  higher  (element  C. 1 ,a( 3) (c )1) 
and/or  occasional  modifications  were  more  costly  to  accomplish 
(elements  C.l.a(l)(c),  C.l.a(2),  C.l.a(5),  and  C.l.a(6)(a). 

Another  example  concerns  computer-based  instruction  and 
conventional  classroom  instruction.  Computer-based  instruc¬ 
tion  systems  generally  are  characterized  by  higher  acquisition 
costs  (i.e.,  R&D  plus  Initial  Investment)  than  are  conventional 
classroom  instruction  systems.  Viewing  acquisition  cost  only, 
one  might  favor  conventional  Instruction.  Computer-based 
instruction,  however,  may  be  self-paced  in  nature,  and  can  be 
employed  to  permit  fast  learners  to  complete  courses  in  less 
time  than  is  needed  for  conventional  instruction;  i.e.,  fast 
learners  are  not  constrained  by  a  pace  set  to  meet  the  need  of 
the  average  student.  Considerable  data  show  that  computer- 
based  instruction  saves,  on  the  average,  25  percent  or  more  of 
the  time  students  need  to  complete  the  same  course  given  by 
conventional  instruction.  Conversely,  over  a  given  time  period 
about  25  percent  more  students  could  complete  a  course  that 
employs  computer-based  instruction.  It  follows  that  if  the 
cost-per-student  of  competitive  computer-based  and  conventional 
classroom  courses  are  compared  on  a  life-cycle  cost  basis,  the 
higher  acquisition  costs  of  the  computer-based  training  system 
might  be  more  than  offset  in  the  operational  phase.  This  out¬ 
come  would  not  be  revealed  if  analysis  were  limited  only  -to 
consideration  of  acquisition  costs. 

Careful  detailing  of  a  work  breakdown  structure  (WBS) 
of  the  training  p/c/d  components  to  which  the  cost  element 
structure  will  be  applied  must  be  emphasized.  For  example, 
an  analysis  limited  to  the  cost  of  computer  hardware  needed 

1  Lower  reliability  would  cause  higher  maintenance  and  replenishment  spares 
costs,  reflected  in  elements  C.l.a(l)Cc),  C,l.a(2),  C.l.a(4),  C.l.a(6), 
and  C.2.b. 


for  computer-based  instruction  might  show  that  acquisition 
costs  have  decreased  markedly  in  recent  years,  and  may  continue 
to  decrease  in  future  years.  It  would  be  incorrect,  however, 
to  omit  from  the  WBS  the  computer  programs  and  course  materials 
(software  and  courseware)  needed  for  computer-based  instruction. 
These  products  require  highly  skilled  personnel  and  their  costs 
have  increased  as  much  as,  or  more  than,  hardware  costs  have 
decreased.  Similarly,  in  comparing  computer-based  instruction 
with  conventional  instruction,  one  might  assume  (incorrectly) 
that  the  costs  of  developing  course  materials  would  be  the  same 
for  both  methods  of  instruction  and,  therefore,  could  be  omitted. 

A.  carefully  constructed  WBS,  however,  would  include  software  as 
a  component  of  the  computer-based  system,  but  not  of  conventional 
instruction,  and  courseware  as  a  component  of  both. 

Even  though  this  paper  is  concerned  only  with  the  problem 
of  identifying  the  costs  of  training  p/c/d's,  it  is  necessary 
to  comment  on  the  companion  problem  of  determining  the  effective¬ 
ness  of  training  p/c/d' s.  It  makes  little  sense  to  select  the 
least-cost  alternative  among  several  systems  to  satisfy  a  par¬ 
ticular  training  requirement  without  regard  to  differences  in 
effectiveness  among  the  alternatives.  Selection  of  the  least- 
cost  alternative  in  the  interest  of  cost  savings  or  cost  avoidance 
might  result  in  an  unacceptably  low  level  of  effectiveness. 

The  choice  of  another  of  the  alternatives  might  be  preferable 
if  much  greater  effectiveness  could  be  achieved  with  only 
slightly  higher  expenditures.  Effectiveness  could  become  the 
deciding  factor,  however,  if  the  candidate  p/c/d’s  were  of 
approximately  equal  cost.  This  is  not  the  place  to  discuss 
the  effectiveness  of  training  other  than  to  say  that  both  cost 
and  effectiveness  must  be  considered  explicitly  in  analysis 
conducted  to  enable  selection  among  alternative  training 
programs,  courses,  or  devices  to  fulfill  a  specific  need.  How¬ 
ever,  to  do  that  will  require  another  paper  of  this  series. 
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CONSTANT  DOLLARS  vs.  THEN- YEAR  DOLLARS:  Cost  escalation 
(inflation)  has  been  a  fact  of  economic  life  for  many  years. 

The  Congress,  which  authorizes  Federal  agencies  to  obligate  and 
expend  money,  must  think  in  terms  of  what  a  program  will  cost 
in  future  years  as  well  as  in  the  budget  year  under  considera¬ 
tion;  thus,  Government  agencies  must  provide  for  anticipated 
cost  escalation  when  requesting  program  funding.  Accordingly, 
budget  requests  for  programs  spanning  several  years  include 
factors  for  escalation;  that  is,  they  are  stated  in  terms  of 
"then-year  dollars."  Cost  estimates  are  usually  presented  in 
studies  as  "constant  dollars,"  which  are  estimates  in  terms  of 
money’s  value  at  a  specified  year.  The  use  of  "constant  dol¬ 
lars"  permits  a  more  meaningful  comparison  of  the  monetary  needs 
of  competing  systems  with  different  time-phased  funding  profiles 
and  provides  a  common  base  for  escalation  to  then-year  dollars. 

COST  AVOIDANCE  reflects  the  reduction  in  costs  of  an  exist- 
ting  system  when  it  is  retired  or  replaced  by  a  new  system. 

COST-ESTIMATING  RELATIONSHIP  (CER)  is  a  mathematical  ex¬ 
pression  that  relates  cost  to  one  or  more  physical  or  perform¬ 
ance  characteristics  of  an  end-item.  CERs  usually  are  derived 
by  simple  or  multiple  regression  analysis  of  historical  cost 
data . 

COST  GROWTH  denotes  a  pattern  of  increases  in  the  cost  of 
a  system  over  what  was  previously  estimated.  For  a  number  of 
reasons,  the  actual  costs  of  weapon  systems  are  virtually  always 
substantially  greater  than  Service  or  contractor  estimates  made 
during  development.  Accordingly,  in  studies  involving  the  cost- 
effectiveness  of  weapon  systems,  current  Service  or  contractor 
cost  estimates  of  systems  not  yet  deployed  should  reflect  prob¬ 
able  future  cost  growth.  Accounting  for  probable  cost  growth 
is  particularly  Important  in  studies  involving  the  relative 


costs  and  effectiveness  of  programs  or  systems  at  different 
stages  of  their  lives.  Use  of  Service  or  contractor  cost  esti¬ 
mates  would  tend  to  favor  those  systems  in  earlier  stages  of 
development  relative  to  other  systems  in  later  stages  of  devel¬ 
opment  or  deployment.  Three  of  the  more  common  ways  in  which 
to  correct  current  cost  estimates  for  probable  future  cost 
growth  are: 

•  Careful  evaluation  of  Service  and  contractor  estimates 
to  identify  omissions  or  understatements  of  cost  ele¬ 
ments  . 

•  The  use  of  CERs  derived  from  data  bases  that  reflect 
past  costs  of  similar  mature  systems. 

•  Examination  of  cost  growth  histories  of  past  programs 
for  similar  systems. 

DISCOUNTING  is  a  procedure  that  is  used  to  account  for  the 
loss  of  investment  potential  by  the  private  sector  when  monies 
are  used  by  the  Government  to  fund  multi-year  programs.  Some¬ 
times  alternative  courses  of  action  by  DoD  have  different  time¬ 
phasing  of  the  costs  involved.  In  such  cases  future  costs  may 
be  discounted  to  directly  comparable  present  values.  OMB  Cir¬ 
cular  No.  A— 9^  directs  the  use  of  discount  rates  in  evaluating 
time-distributed  costs.  The  prescribed  discount  rate  at  present 
(1982)  is  ten  percent. 

EXPENDITURES  or  OUTLAYS  represent  the  spendout  of  obliga- 
tional  authority  over  the  years  necessary  to  complete  the 
authorized  transactions. 

INHERITED  ASSETS  are  multi-purpose  assets  which  can  be 
used  by  several  military  systems  (e.g.,  airfield  facilities). 

If  multi-purpose  assets  are  available,  they  may  be  passed  on  to 
or  inherited  by  new  systems  without  incurring  obligational 
authority  or  expenditures.  Inherited  assets  and  the  concept  of 
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residual  value  are  closely  related;  if  an  asset  is  inherited  by 
a  new  system  it  necessarily  had  a  residual  value  from  its  prior 
use . 

THE  LEARNING  CURVE  is  used  in  estimating  the  procurement 
costs  of  major  itmes  of  equipment  (aircraft,  missiles,  etc.). 

It  is  a  mathematical  expression  of  the  fact  that  the  cost  of  a 
product  decreases  at  some  predictable  rate  as  the  quantity  pro¬ 
duced  is  increased.  Originally  recognized  in  the  labor  (man¬ 
hours)  required  to  manufacture  a  product,  the  phenomenon  has 
been  found  to  apply  to  the  cost  of  a  manufactured  product  as  a 
whole.  As  such,  it  may  be  more  properly  referred  to  as  a  "cost- 
improvement"  or  a  "cost-quantity"  curve. 

LIFE-CYCLE  COSTS  are  the  total  costs  from  the  inception  of 
a  program  or  system  to  the  end  of  its  useful  life  (cradle-to- 
grave).  There  are  two  problems  with  this  method  of  cost  aggre¬ 
gation.  First,  it  includes  costs  for  all  prior  years.  These 
costs  are  spent,  or  "sunk"  and  cannot  be  affected  by  decision¬ 
makers.  The  other  problem  is  that  the  end  of  a  system's  useful 
life  is  highly  speculative  and  usually  it  is  not  necessary  to 
consider  the  phase-out  period  of  a  system  in  order  to  properly 
reflect  the  differences  among  alternative  courses  of  action. 

OPPORTUNITY  COST  Is  the  value  of  resources  that  could  be 
employed  in  two  or  more  programs,  but  being  assigned  to  one, 
denies  the  benefits  of  their  use  to  other  programs.  The  oppor¬ 
tunity  cost  concept  recognizes  that  resources  are  limited. 
Opportunity  costs  can  reveal  hidden  costs  that  are  not  reflected 
In  direct  budgets;  for  example,  use  of  government-owned  facili¬ 
ties  or  land. 


OUTLAYS  (See  EXPENDITURES,  above) 


PROGRAM  ACQUISITION  COST  is  the  sum  of  R&D  and  Initial 
Investment  costs  of  a  military  system. 

PROGRAM  COSTS  are  the  total  expenditures  or  Total  Obliga- 
tional  Authority  (TOA),  by  fiscal  year,  that  would  be  incurred 
during  a  specific  time  period.  The  major  advantage  of  aggregat 
ing  costs  by  program  costs  is  that  they  capture  all  of  the 
expenditures  or  TOA  required  for  a  system  over  the  time  period 
of  interest.  Program  costs  consider  equipment  delivery  sched¬ 
ules,  deployment  schedules,  and  periods  during  which  systems 
would  be  introduced  into,  or  phased  out  of,  the  inventory. 
Program  costs  in  TOA  are  also  the  structure  of  costs  presented 
in  the  Five-Year  Defense  Program  (FYDP).  Program  costs  differ 
from  system  costs  in  that  program  costs  (a)  include  the  operat¬ 
ing  and  support  costs  during  force  build-up  or  phase-down,  and 
(b)  present  the  cost  categories  year-by-year  rather  than  as 
totals . 

RESIDUAL  VALUE  refers  to  the  value  that  can  be  recaptured 
when  a  system  is  phased  out.  Sometimes  material  or  facilities 
can  be  sold  or  diverted  to  other  government  use.  Usually  the 
residual  value  of  a  weapon  system  is  neglible,  but  occasionally 
as  in  the  recycling  of  nuclear  materials,  it  may  be  significant 

SUNK  COST  refers  to  costs  already  obligated  or  expended 
prior  to  the  present  time  period.  Sometimes  present  and  near- 
term  costs  than  cannot  be  affected  by  present  decisions  are  als 
treated  as  sunk  costs.  Sunk  costs  normally  have  no  bearing  on 
current  management  decisions. 

SYSTEM  COSTS  ar,e  the  total  of  the  R&D,  initial  investment, 
and  some  number  of  years  (usually  10  or  15)  of  operating  and 
support  costs  once  a  relatively  constant  level  of  activity  of  a 
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fully  deployed  force  is  reached.  Thus,  the  aggregation  of  costs 
into  system  costs  is  an  analytic  convenience  to  simplify 
comparing  the  costs  of  two  or  more  systems. 

THEN- YEAR  DOLLARS  (See  CONSTANT  DOLLARS.  ...»  above). 

TOTAL  OBLIGATIONAL  AUTHORITY  (TOA)  represents  authorization 
by  Congress  to  obligate  funds  for  expenditure  in  present  and 
future  years. 
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APPENDIX  B 


RELATIONSHIPS  BETWEEN  COST  ELEMENTS  FOR  TRAINING 
AND  DEPARTMENT  OF  DEFENSE  BUDGET  APPROPRIATIONS 
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The  cost  element  structure  (CES)  developed  in  this  paper 
is  intended  to  capture  all  of  the  costs  that  might  be  incurred 
to  develop,  produce,  conduct  and  maintain  any  military  training 
program,  course,  or  device  (p/c/d)  throughout  its  life  cycle. 

The  funding  required  to  fulfill  the  functions,  activities 
and  resources  indicated  by  the  cost  elements  is  requested  by 
the  DoD  from  the  Congress  in  a  budget  that  is  categorized  as 
appropriations.  The  Congress,  in  turn,  grants  the  DoD  the  au¬ 
thority  to  obligate  and  expend  funds,  by  appropriation. 

Knowledge  of  the  relationships  between  these  cost  elements 
and  the  appropriations  by  which  they  would  be  funded  is  not  es¬ 
sential  to  the  purpose  for  which  this  CES  was  developed,  i.e., 
estimating  the  cost-effectiveness  of  alternative  training  p/c/d's 
It  was  felt,  however,  that  it  would  be  useful  to  identify  the 
relationships  between  cost  elements  and  appropriations  (often 
called  a  "cross-walk")  in  order  to  facilitate  communication 
among  training  and  weapon  system  managers,  cost  analysts  and 
budget  analysts,  and  to  make  more  visible  to  decisionmakers  at 
various  levels  the  impact  of  resource  requirements  on  the  fund¬ 
ing  needed  for  alternative  training  modes. 

Table  B-l  illustrates  the  cost  element-to-appropriation 
cross-walk  developed  for  the  R&D  cost  category.  The  principal 
references  used  in  its  development  include  the  DoD  Budget 
Guidance  Manual  (July  1982),  clarifying  discussions  with  offi¬ 
cials  responsible  for  budget  appropriations  policy  in  the  office 
of  the  Deputy  Assistant  Secretary  (Program/Budget),  and  the 
cost  element  definitions  in  Section  III  of  this  paper.  Per¬ 
sonnel  of  the  Services'  training  management  headquarters1  also 
were  consulted  to  determine  funding  sources  for  Instructional 
System  Development  activities  and  resources. 

1  Chief  of  Naval  Education  and  Training,  Pensacola,  Florida;  Air  Force  Air 
Training  Corrmand,  Randolph  AFB,  Texas;  and  Army  Training  and  Doctrine 
Command,  Fort  Monroe,  Virginia. 


m 


The  first  and  third  columns  identify  the  cost  elements 
that  are  the  subjects  of  Table  1  and  Section  III.  The  second 
column  refers  to  the  Notes  at  the  end  of  Table  B-l,  which  sup¬ 
port  the  association  of  resources  and  their  sources  of  funding.  . 

Generally,  the  notes  comprise  synopses  of  applicable  sections 
of  the  Budget  Guidance  Manual  and  discussions  with  officials  g* 

of  the  Services'  training  management  headquarters. 

The  cost  elements  shown  in  the  third  column  include  re¬ 
sources  required  to  fulfill  various  functions  needed  to  develop 
training  p/c/d's.  For  some  extensive  and  costly  training  p/c/d’s 
(e.g.,  a  new  trainer  aircraft)  the  list  of  In-House  resources 
may  be  incomplete;  for  relatively  low-cost  p/c/d's  (e.g.,  group 
classroom  instruction)  the  list  may  be  too  extensive.  Table  B-l 
was  developed,  however,  with  all  p/c/d's  in  mind,  and  illustrates  ^ 

the  fact  that  the  association  of  cost  elements  and  the  budget 
appropriations  by  which  they  would  be  funded  is  a  function  of 
the  resources  required  to  perform  the  functions  indicated  by  ! 

the  descriptive  titles  .of  the  cost  elements.  ® 

It  appears  that  the  association  of  cost  elements  and  bud-  J 

get  appropriations  cannot  be  standardized  for  all  training  p/c/d's. 

This  exercise  indicates  that  it  is  feasible  to  formulate  a  cross¬ 
walk  that  is  applicable  to  all  training  p/c/d's;  however,  dif¬ 
ferences  in  the  kinds  of  resources  needed  among  training  p/c/d's, 
the  post-R&D  disposition  of  those  resources,  and  the  organiza¬ 
tions  by  which  the  work  is  done,  suggest  that  such  a  cross-walk 
is  not  a  useful  tool  for  management  analysis.  For  this  reason, 
cross-walks  for  the  Initial  Investment  and  Operating  and  Support 
cost  categories  were  not  developed.  If  a  cross-walk  is  desired 
for  planning  and  budgeting  purposes,  it  probably  would  be  done 
best  with  specific  information  on  how  and  by  whom  each  training 
p/c/d  would  be  accomplished 
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Table  B-l  (continued) 


A.5. 


1 

2 

3 

3 

3 

3,4,6 

5 

3,4,5 

3 

3 


Prototype  Manufacturing 
ln-house 

Military  Personnel 
Civilian  Personnel 
Other 

Purchased  Services 

Raw  &  Semi-finished  Matls. 

Mlsc.  Materials 

Purchased  Parts 

GOE 

Test  &  Inspection  Eqpmt. 
Special  Tools 

Contractor 


RDT&E 
Mil.  Pers. 
Family  Hsg. 
O&M 

Procurement 
Mil.  Cons. 


A. 7. 


1 

2 

3 

3 

3,4 

3 

3,4,5 

7 

3 


P/C/0/  Test  and  Evaluation 
ln-house 

Military  Personnel 
Civilian  Personnel 
Other 

Purchased  Services 
Mlsc.  Materials 
Consumables 

Range/AIrfleld/Carrler  Utilization 

Test  Equipment- 

Munitions 

Contractor 


ROT&E 
Mil.  Pers. 
Family  Hsg. 
O&M 

Procurement 
Mil.  Con. 


A. 9.  8 


Facilities 

Construction 

Modification 

Installation 

Maintenance 

Utilities 


RDT&E 

Mil.  Pers. 
Family  Hsg. 
O&M 

Procurement 
Mil.  Con. 


NOTES: 


1  . 


The  P&A  and  PCS  costs  for  military  personnel  are  funded 
by  the  Military  Personnel  (Mil  Pers)  appropriation. 
Other  military  personnel  costs  (TDYi  health  care,  per¬ 
sonnel  replacement,  and  transients,  patients,  and  pris¬ 
oners)  are  funded  by  the  Operations  and  Maintenance 
(O&M)  appropriation.  The  costs  of  government-owned 
family  housing  (construction,  furnishings,  and  mainte¬ 
nance)  occupied  by  military  personnel  are  paid  from 
the  Family  Housing  appropriations.  These  cost  element 


Table  B-l  (continued) 


and  appropriation  relationships  hold,  regardless  of  the 
training  function  or  activity  in  which  military  person¬ 
nel  are  engaged  or  their  duty  assignments  (e.g.,  man¬ 
ager,  administrator,  instructor,  student,  technician) 
[Deputy  Assistant  Secretary  of  Defense  (Program/Budget)]. 

2.  The  costs  of  civilian  (civil  service)  personnel  engaged 
in  training  R&D  activities  may  be  funded  by  the  RDT&E 
or  the  O&M  appropriations.  The  choice  depends  upon  the 
source  of  funding  of  the  organization  by  which  they  are 
employed.  The  costs  of  civilian  employees  of  the  Air 
Force's  Deputy  for  Simulators  (SIMSPO),  for  example, 
are  funded  by  the  RDT&E  appropriation  because  the 
SIMSPO  is  an  office  of  the  Air  Force  Systems  Command, 
which  is  an  R&D  organization.  On  the  other  hand,  civil¬ 
ian  employees  of  the  Air  Force  Air  Training  Command 
(ATC)  are  funded  from  O&M  because  the  costs  of  ATC's 
activities  are  defrayed  principally  by  the  O&M  appro¬ 
priation  [Deputy  Assistant  Secretary  of  Defense  (Pro¬ 
gram/Budget)  and  FYDP ,  January  1983]. 

3.  The  guidance  for  funding  civilian  personnel  (i.e.,  a 
function  of  the  source(s)  of  funding  available  to  the 
organization  conducting  the  R&D)  also  may  apply  to  other 
resources  required  to  fulfill  the  functions  of  some  cost 
elements.  Purchased  parts,  purchased  services,  and  R&D 
work  by  contractors,  for  example,  might  be  funded  either 
by  RDT&E  or  O&M  appropriations  [Program  Development 
Center,  CNET,  August  1983;  U.S.  Army  TRADOC,  Ju1^  1983; 
Cost  and  Management  Analysis,  USAF  ATC,  July  1933]. 

4.  Articles  (including  end  items,  weapons,  equipment,  com¬ 
ponents,  and  materials)  of  types  regularly  procured  to 
meet  established  general  requirements,  but  which  are 
used  in  support  of  RDT&E-funded  R&D  programs,  may  be 
financed  by  Procurement  appropriations  if  they  are  not 
consumed  in  R&D.  The  RDT&E  appropriation  would  bear 
the  costs  of  articles  consumed  in  R&D,  and  the  costs 

of  returning  used  articles  to  serviceable  condition 
for  other  use  [Budget  Guidance  Manual,  July  1982, 
p.  251-5].  Note  that  this  guidance  applies  specifi¬ 
cally  to  RDT&E-funded  programs  (e.g.,  trainer  aircraft 
and  large  simulators),  but  it  also  is  adopted  for  0&M- 
funded  R&D  such  as  ISD  for  computer-based  instruction. 
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Major  end  items  (such  as  weapons,  test  vehicles,  equip¬ 
ment,  or  major  components  thereof)  made  available  from 
existing  inventory  for  the  R&D  phase  of  a  training  pro¬ 
gram,  course,  or  device  will  not  be  charged  to  RDT&E 
unless  they  are  consumed  in  R&D.  RDT&E  will  finance 
the  costs  of  returning  such  items  to  serviceable  con¬ 
dition  for  further  use  [Idem,  p.  251-6].  (Substitute 
"O&M"  for  "RDT&E"  for  R&D  efforts  that  are  financed 
by  O&M  appropriations.) 

Training  devices  that  employ  new  or  off-the-shelf  com¬ 
puters  and  components,  but  have  unique  software  and 
interface  components,  will  be  purchased  and  developed 
with  RDT&E  funds  [Idem,  p.  251-10]. 

Consumable  rounds  of  ammunition  or  tactical  missiles 
procured  for  inventory  may  be  issued  for  use  in  R&D 
testing  without  reimbursement  (unless  reimbursement 
is  specifically  required)  [Idem,  p.  251-6]. 

The  Military  Construction  appropriations  fund  acquisi¬ 
tion,  construction  and  installation  above  the  $100,000 
threshold.  The  acquisition  or  construction  of  indus¬ 
trial  facilities  at  government-owned  (government-  or 
contractor-operated)  R&D  installations  or  activities 
will  be  funded  by  RDT&E  appropriations  if  the  cost  is 
less  than  $100,000.  RDT&E  appropriations  also  finance, 
to  the  $100,000  limit,  the  costs  associated  with  the 
installation  of  equipment  or  instrumentation  in  an 
RDT&E- fi na need  government  facility;  however,  the  RDT&E 
appropriations  do  not  fund  any  installation  costs  if 
installation  work  is  accomplished  concurrently  with 
a  Military  Construct!' on- funded  project  [Idem,  p.  251-1, 
-2,  -3]. 


